https://blog.foundev.pro/tags/Spark.htmlRecent content in Spark on Random RamblingsHugoen-usTue, 05 Apr 2016 00:00:00 +0000https://blog.foundev.pro/2016/04/05/spark-job-that-writes-to-cassandra-just-hangs-when-one-node-goes-down.htmlTue, 05 Apr 2016 00:00:00 +0000https://blog.foundev.pro/2016/04/05/spark-job-that-writes-to-cassandra-just-hangs-when-one-node-goes-down.html<h1>Spark job that writes to Cassandra just hangs when one node goes down?</h1> ### <span style="font-size: 16px;">So this was hyper obvious once I saw the executor logs and the database schema, but this had me befuddled at first and the change in behavior with one node should have made it obvious.</span> {#23da} <p id="f2c8"> The code was simple, read a bunch of information, do some minor transformations and flush to Cassandra. This was nothing crazy. But during the users fault tolerance testing, the job would just seamingly hang indefinitely when a node was down. </p>