Scaling Python with Ray: Adventures in Cloud and Serverless Patterns

by Holden Karau, Boris Lublinsky

Overview

Serverless computing enables developers to concentrate solely on their applications rather than worry about where they've been deployed. With the Ray general-purpose serverless implementation in Python, programmers and data scientists can hide servers, implement stateful applications, support direct communication between tasks, and access hardware accelerators.

In this book, experienced software architecture practitioners Holden Karau and Boris Lublinsky show you how to scale existing Python applications and pipelines, allowing you to stay in the Python ecosystem while reducing single points of failure and manual scheduling. Scaling Python with Ray is ideal for software architects and developers eager to explore successful case studies and learn more about decision and measurement effectiveness.

If your data processing or server application has grown beyond what a single computer can handle, this book is for you. You'll explore distributed processing (the pure Python implementation of serverless) and learn how to:

• Implement stateful applications with Ray actors
• Build workflow management in Ray
• Use Ray as a unified system for batch and stream processing
• Apply advanced data processing with Ray
• Build microservices with Ray
• Implement reliable Ray applications

Product Details

ISBN-13:	9781098118808
Publisher:	O'Reilly Media, Incorporated
Publication date:	01/03/2023
Pages:	266
Product dimensions:	7.00(w) x 9.19(h) x (d)

About the Author

Holden Karau is a queer transgender Canadian, Apache Spark committer, Apache Software Foundation member, and an active open source contributor. As a software engineer, she's worked on a variety of distributed computing, search, and classification problems at Apple, Google, IBM, Alpine, Databricks, Foursquare, and Amazon. She graduated from the University of Waterloo with a bachelor of mathematics in computer science. Outside of software, she enjoys playing with fire, welding, riding scooters, eating poutine, and dancing.

Boris Lublinsky is a Chief Architect for IBM's Discovery Accelerator Platform, where he specializes in Kubernetes, serverless, workflows, and complex systems design. Boris has over 30 years of experience in enterprise architecture and software development. He is the co-author of Applied SOA (Wiley), Professional Hadoop Solutions (Wiley), Serving Machine Learning Models (O'Reilly), and Kubeflow for Machine Learning (O'Reilly). He is also a contributor to several open-source projects. Boris is a frequent speaker at numerous industry conferences and co-founder of several Chicago user groups.