Dataset research + resources

[mrdbourke]

Starting this to take note of different food image datasets out there.

The goal will be to eventually have the largest food image dataset on the internet.

Post comments of anything you find and I'll collate them here.

Datasets online

We'll need lots of food images, so the more we can find open source (before the app is built and we start collecting custom images), the better.

• 800k food images from Instagram - https://homepages.inf.ed.ac.uk/thospeda/downloads.html
• PASS, 1.4M images like ImageNet but without people (this is good because Nutrify will train on images of food but not people) - https://www.robots.ox.ac.uk/~vgg/research/pass/
• More images of food via Papers With Code Dataset page - https://paperswithcode.com/datasets?q=food&v=lst&o=match

From @ashikshafi08

• FoodX-251 Dataset | Papers With Code
• Nutrition 5k dataset
• simplified-recipes-1M Dataset - Dominik Schmidt
• Epirecipes
• Recipe Ingredients Dataset | Kaggle
• Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images - MIT

Nutrition APIs

When Nutrify classifies an image, we'll want to display the food's appropriate nutrition information, below are a list of potential nutrition APIs.

• Top 12 nutrition APIs - https://rapidapi.com/collection/nutrition
• US Department of agriculture API - https://fdc.nal.usda.gov/api-guide.html
• MyNetDiary food API (cost) - https://www.mynetdiary.com/food-database.html

Labeling and data exploration

• Can use FitfyOne to explore data, download popular datasets and find mistakes - https://voxel51.com/docs/fiftyone/tutorials/open_images.html

[ashikshafi08]

So far I have found these resources and this will be updated as I find new things.

Papers

• Inverse Cooking: Recipe Generation from Food Images | Papers With Code
• Nutrition5k: Towards Automatic Nutritional Understanding of Generic Food | Papers With Code
• DeepFood: Deep Learning-Based Food Image Recognition for Computer-Aided Dietary Assessment
• Food Ingredients Recognition through Multi-label Learning
• Deep Learning-Based Food Calorie Estimation Method in Dietary Assessment | Papers With Code
• RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and Evaluation System | Papers With Code
• Now You’re Cooking! Benchmark (Recipe Generation) | Papers With Code
• Food.com
• RecipeNLG: A Cooking Recipes Dataset for Semi-Structured Text
  Generation

Datasets

• FoodX-251 Dataset | Papers With Code
• Nutrition 5k dataset
• simplified-recipes-1M Dataset - Dominik Schmidt
• Epirecipes
• Recipe Ingredients Dataset | Kaggle
• Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images - MIT

[mrdbourke]

Thank you thank you thank you!

[mrdbourke]

Good amount of food data with image instance segmentation - https://xiongweiwu.github.io/foodseg103.html