Subscribe to our blog

aimlbook

 

One of the great benefits of container-based infrastructure is the ability to provision huge swaths of servers at once. This translates into a capability you could call dynamic environment provisioning: spinning up large sets of nodes all preconfigured to work together on a single task like a Hadoop job, a message queue or an Elasticsearch. Just as with software in other realms, the job of provisioning and making available these complex application environments is becoming easier and faster over time, here thanks to Kubernetes, Istio and Linux containers.

AI/ML jobs often require lots of servers to process large amounts of data and produce a model, at which time they don't need to do anything at all until the next job. You don't want to pay for those servers when they're not in use, but you also need tremendous scale to produce results in a timely fashion. It's a scenario that would have choked a team of 20 IT professionals and filled a datacenter in the early 2000's, but which can now be performed by a single individual, given a properly instrumented, secure and open hybrid cloud filled with the necessary data.

We've produced an ebook outlining exactly what you should take into consideration when building out a production-ready AI/ML environment without breaking the bank or wasting the time of your data scientists. With proper planning, monitoring and pipelines, your AI/ML teams can increase their velocity and productivity through automated provisioning of environments.


About the author

Red Hatter since 2018, tech historian, founder of themade.org, serial non-profiteer.

Read full bio

Browse by channel

automation icon

Automation

The latest on IT automation that spans tech, teams, and environments

AI icon

Artificial intelligence

Explore the platforms and partners building a faster path for AI

open hybrid cloud icon

Open hybrid cloud

Explore how we build a more flexible future with hybrid cloud

security icon

Security

Explore how we reduce risks across environments and technologies

edge icon

Edge computing

Updates on the solutions that simplify infrastructure at the edge

Infrastructure icon

Infrastructure

Stay up to date on the world’s leading enterprise Linux platform

application development icon

Applications

The latest on our solutions to the toughest application challenges

Original series icon

Original shows

Entertaining stories from the makers and leaders in enterprise tech