AI-Hypercomputer

All

18 repositories

maxtext
Public
A simple, performant and scalable Jax LLM!
gpt large-language-models llm
Python
•
Apache License 2.0
•326•1.6k•35•151•Updated Mar 6, 2025Mar 6, 2025
ray-tpu
Public
Python
•
Apache License 2.0
•3•5•2•0•Updated Mar 6, 2025Mar 6, 2025
JetStream
Public
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
gpu inference pytorch transformer llama gpt gemma model-serving tpu jax
Python
•
Apache License 2.0
•36•289•11•8•Updated Mar 6, 2025Mar 6, 2025
torchprime
Public
TorchPrime is a reference model implementation for PyTorch on TPU/GPU.
Python
•
Other
•1•11•45•6•Updated Mar 6, 2025Mar 6, 2025
tpu-recipes
Public
Shell
•
Apache License 2.0
•10•13•3•8•Updated Mar 6, 2025Mar 6, 2025
kithara
Public
Python
•
Apache License 2.0
•2•4•0•2•Updated Mar 6, 2025Mar 6, 2025
gpu-recipes
Public
Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
gpu benchmarks google-cloud-platform serving distributed-training
Shell
•
Apache License 2.0
•7•41•1•0•Updated Mar 6, 2025Mar 6, 2025
xpk
Public
xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
gke gcloud tpu
Python
•
Apache License 2.0
•32•106•14•28•Updated Mar 6, 2025Mar 6, 2025
maxdiffusion
Public
Python
•
Apache License 2.0
•23•192•4•8•Updated Mar 5, 2025Mar 5, 2025
accelerator-microbenchmarks
Public
Python
•
Apache License 2.0
•1•0•0•0•Updated Mar 5, 2025Mar 5, 2025
cloud-accelerator-diagnostics
Public
Python
•
Apache License 2.0
•9•20•3•0•Updated Mar 3, 2025Mar 3, 2025
inference-benchmark
Public
Python
•
Apache License 2.0
•3•2•2•1•Updated Feb 28, 2025Feb 28, 2025
pathways-utils
Public
Package of Pathways-on-Cloud utilities
Python
•
Apache License 2.0
•2•7•0•2•Updated Feb 26, 2025Feb 26, 2025
cloud-tpu-monitoring-debugging
Public
HCL
•
Apache License 2.0
•1•11•0•0•Updated Feb 18, 2025Feb 18, 2025
jetstream-pytorch
Public
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
inference pytorch batching attention llama gemma model-serving tpu llm llm-inference
Python
•
Apache License 2.0
•17•53•9•5•Updated Feb 10, 2025Feb 10, 2025
ml-goodput-measurement
Public
Python
•
Apache License 2.0
•1•12•0•1•Updated Feb 4, 2025Feb 4, 2025
aotc
Public
Python
•
Other
•0•0•0•0•Updated Dec 18, 2024Dec 18, 2024
RankML
Public
Python
•
Apache License 2.0
•1•3•0•1•Updated Oct 24, 2024Oct 24, 2024