Who doesn’t need Free GPU? Each one craves it, particularly when it’s free!
There are already self hosted Jupyter Pocket book companies like Google Collab, Kaggle’s Pocket book and AWS Sagemaker. Nonetheless, in case you’ve used these platforms to coach Neural Networks, you should have confronted numerous Session Timeouts and even cuda out of reminiscence errors a number of occasions. They usually provide T4 GPU Mannequin at max for free-tier, which offers 65 TFLOPS and 16 gigs reminiscence. Personally, I don’t take into account T4 to be a top-tier GPU as a result of its velocity and the fixed platform timeouts.
So whats the choice. Lightning AI. Purpose you ask?
A10G with 125 TFLOPS and 24 GB RAM.
A10G affords 3.3x higher ML coaching efficiency and as much as 3x higher ML inferencing and graphics efficiency than T4 GPUs. However efficiency isn’t the one motive why I desire Lightning AI. I like that I can join through ssh on my native potato machine and even code on my native VS code. Plus, you should use not solely Jupyter Pocket book right here, but additionally Streamlit and gradio for the web-app deployment and even TensorBoard plugins to coach fashions.
8 hours of GPU/ month. The catch is that that is restricted to eight hours of A10G utilization solely each month. Nonetheless, they provide quests like Run an AI internet app that annotates pictures. Finishing these quests earns you a further 11 hours of GPU time. Within the free model you may solely use T4, L4 and A10G GPUs. For entry to A100 and H100 GPUs, you’ll must improve to Groups, and for multi-GPU machines, it’s worthwhile to improve to Professional. Even on the free tier, the rewards from quests and month-to-month Lightning credit are adequate for duties like classification, segmentation, GANs, and even fine-tuning LLMs.
In case you’re nonetheless skeptical and assume the GPU hours are too low, I’m freely giving 100 Lightning credit price of $100 {dollars} to considered one of you. To be eligible, simply drop a response(remark) under. A random winner can be contacted on July 20, 2024. Observe that, this publish shouldn’t be sponsored by Lightning AI. That is personally funded and never affiliated with Lightning AI.
Thanks for studying and keep tuned !
