Sparklens - Understanding the Scalability Limits of Spark Applications

Sparklens - Understanding the Scalability Limits of Spark Applications

Event Agenda

18:30 - 19:00

Arrival and socialising

19:00 - 20:00

Matthew Browning and Tom Mack, Qubole

"Sparklens - Understanding the Scalability Limits of Spark Applications"

Sparklens, an OSS profiling tool, provides insights about scalability limits of given spark application. In this talk we will cover what Sparklens does and theory behind Sparklens. We will talk about how structure of spark application puts important constraints on its scalability. How can we find these structural constraints and how to use these constraints as a guide in solving performance and scalability problems of spark applications.

Big thanks to ImpactHub for sponsoring the location: The global community of entrepreneurial people prototyping the future of business. At Impact Hub, you can connect, collaborate, co-work and create great content in an inspiring environment.