Skip to content

Commit

Permalink
feat: added ep 110
Browse files Browse the repository at this point in the history
  • Loading branch information
lmammino committed Jan 18, 2024
1 parent c7cfe55 commit 9631e1b
Showing 1 changed file with 27 additions and 0 deletions.
27 changes: 27 additions & 0 deletions src/episodes/110-lambda-for-machine-learning.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
---
episode: 110
title: "Why should you use Lambda for Machine Learning?"
youtube_id: "W8IRAYNNZQ8"
spotify_link: "https://podcasters.spotify.com/pod/show/aws-bites/episodes/110--Why-should-you-use-Lambda-for-Machine-Learning-e2eirgt"
publish_date: 2024-01-19
---

In this episode, we discuss using AWS Lambda for machine learning inference. We cover the tradeoffs between GPUs and CPUs for ML, tools like ggml and llama.cpp for running models on CPUs, and share examples where we've experimented with Lambda for ML like podcast transcription, medical imaging, and natural language processing. While Lambda ML is still quite experimental, it can be a viable option for certain use cases.

> AWS Bites is brought to you by fourTheorem, the ultimate AWS partner for modern applications on AWS. We can help you to be successful with AWS! Check us out at [fourtheorem.com](https://fourtheorem.com)!

In this episode, we mentioned the following resources.

- Episode [46. How do you do machine learning on AWS?](/46-how-do-you-do-machine-learning-on-aws/)
- Episode [108. How to Solve Lambda Python Cold Starts](/108-how-to-solve-lambda-python-cold-starts/)
- [ggml (the framework)](https://github.com/ggerganov/ggml)
- [ggml (the company)](https://ggml.ai)
- [llama.cpp](https://github.com/ggerganov/llama.cpp)
- [whisper.cpp](https://github.com/ggerganov/whisper.cpp)
- [whisper.cpp WebAssembly demo](https://whisper.ggerganov.com/)
- [ONNX Runtime](https://onnxruntime.ai/)
- An example of [using whisper.cpp with the Rust bindings](https://github.com/lmammino/whisper-rs-example)
- Project [running Whisper.cpp in a Lambda function](https://github.com/eoinsha/whisper_lambda_cpp)
- [AWS Lambda Image Container Chest X-Ray Example](https://github.com/fourTheorem/lambda-image-cxr-detection)
- Episode [103. Building GenAI Features with Bedrock](/103-building-genai-features-with-bedrock/)

0 comments on commit 9631e1b

Please sign in to comment.