Go to content

DataStax | Spark Streaming App with DSE File System (Rocco Varela)

Slides: https://www.slideshare.net/DataStax/datastax-building-a-spark-streaming-app-with-dse-file-system-rocco-varela-cassandra-summit-2016/edit | In this talk, we review a real-world use case that tested the Cassandra+Spark stack on Datastax Enterprise (DSE). We also cover implementation details around application high availability and fault tolerance using the new DSE File System (DSEFS). From a field and testing perspective, we discuss the strategies we can leverage to meet our requirements. Such requirements include (but not limited to) functional coverage, system integration, usability, and performance. We will discuss best practices and lessons we learned covering everything from application development to DSE setup and tuning. About the Speaker Rocco Varela Software Engineer in Test, DataStax After earning his PhD in bioinformatics from UCSF, Rocco Varela took his passion for technology to DataStax. At DataStax he works on several aspects of performance and test automation around DataStax Enterprise (DSE) integrated offerings such as Apache Spark, Hadoop, Solr, and more recently DSE Graph.

July 26, 2016