End of support: Spark version 1.6 in Analytics for Apache Spark
  • Apache Spark
  • United Kingdom
    US South
  • Description
    We would like to inform you about the withdrawal of support for Apache Spark v1.6 in the IBM Analytics for Apache Spark service, which will end on March 30, 2018. However, this service will continue to support newer Apache Spark versions under the Spark 2.x branch – namely Spark v2.0 and Spark v2.1.2.

    As part of our effort to provide a current, secure and GDPR compliant cloud service, several security vulnerabilities are being identified and repaired. A number of them present in Spark v1.6 have been fixed in the Spark v2.x branch. In addition, Spark v2.x introduced newer capabilities and performance improvements, for example:
    • Kafka 0.10.0 support
    • Structured streaming support
    For more a more complete list of changes added to Apache Spark, consult the release notes for the Spark release at (Spark 2.0, Spark 2.1).

    The support for Apache Spark v1.6 will be withdrawn on March 30, 2018. Here’s what you need to know:
    • The End of Support Announce Date is January 30, 2018.
    • The End of Support Withdrawal Date is March 30, 2018.
    • For a period of 60 days after the End of Support Announce Date, through March 30, 2018, all new or existing instances of Analytics for Apache Spark will have the ability to submit and execute jobs using a Spark v1.6 kernel or driver. However, as of March 30, 2018, new or existing kernels or jobs cannot be submitted to execute with the Spark v1.6 driver.
    • You need to update your applications and notebooks to use Spark v2.1.2 APIs before the End of Support Withdrawal Date on March 30, 2018.
    We strongly recommend that you to move your applications to Spark v2.1.2. It will give you access to the latest APIs and capabilities of Apache Spark to stay compliant with the GDPR requirements. Also, you can follow these migration guidelines to upgrade.

    This information originated in the End of support for Spark version 1.6 in Analytics for Apache Spark article within the IBM Cloud platform blog.