Source link : https://tech365.info/scaleops-new-ai-infra-product-slashes-gpu-prices-for-self-hosted-enterprise-llms-by-50-for-early-adopters/
ScaleOps has expanded its cloud useful resource administration platform with a brand new product aimed toward enterprises working self-hosted giant language fashions (LLMs) and GPU-based AI purposes.
The AI Infra Product introduced at the moment, extends the corporate’s current automation capabilities to handle a rising want for environment friendly GPU utilization, predictable efficiency, and diminished operational burden in large-scale AI deployments.
The corporate mentioned the system is already working in enterprise manufacturing environments and delivering main effectivity beneficial properties for early adopters, decreasing GPU prices by between 50% and 70%, in keeping with the corporate. The corporate doesn’t publicly record enterprise pricing for this answer and as a substitute invitations prospects to obtain a customized quote based mostly on their operation measurement and wishes right here.
In explaining how the system behaves underneath heavy load, Yodar Shafrir, CEO and Co-Founding father of ScaleOps, mentioned in an e-mail to VentureBeat that the platform makes use of “proactive and reactive mechanisms to handle sudden spikes without performance impact,” noting that its workload rightsizing insurance policies “automatically manage capacity to keep resources available.”
He added that minimizing GPU cold-start delays was a precedence, emphasizing that the system “ensures instant response when traffic surges,” notably for AI workloads the…
—-
Author : tech365
Publish date : 2025-11-20 18:02:00
Copyright for syndicated content belongs to the linked Source.
—-
1 – 2 – 3 – 4 – 5 – 6 – 7 – 8