Withdrawal of support: Apache Spark v2.0 in IBM Analytics for Apache Spark
  • Apache Spark
  • United Kingdom
    US South
  • Description
    We would like to inform you about the withdrawal of support for Apache Spark v2.0 in IBM Analytics for Apache Spark, which will end on April 30, 2018. However, this service will continue to support Apache Spark versions under the Spark 2.1.x branch.

    As part of our effort to provide a current, secure and GDPR-compliant cloud service, several security vulnerabilities are being identified and repaired. A number of those vulnerabilities, which are present in Spark v2.0, have been fixed in the Spark v2.1 branch. In addition, Spark 2.1 API is compatible with Spark 2.0. Minimal upgrade updates are needed to move from version 2.0 to 2.1.x.

    For a more complete list of changes added to Apache Spark, consult the release notes for the Spark release at Spark 2.1. The support for Apache Spark v2.0 will be withdrawn on April 30, 2018.

    Here’s what you need to know:
    • The End of Support Announce date is February 27, 2018.
    • The End of Support Withdrawal Date is April 30, 2018.
      For the period after the End of Support Announce Date, through April 30, 2018, all new or existing instances of Analytics for Apache Spark will have the ability to submit and execute jobs using a Spark v2.0 kernel or driver. As of April 30, 2018, new or existing kernels or jobs cannot be submitted to execute with Spark v2.0 driver. Remember to update your applications and notebooks to use Spark v2.1.2 APIs before the End of Support Withdrawal Date on April 30, 2018.
    We strongly recommend you to move your applications to Spark v2.1.2 to get access to the latest APIs and capabilities of Apache Spark to stay compliant with the GDPR requirements. Also, you can follow these migration guidelines to upgrade.

    This information originated in the End of support for Spark version 2.0 in Analytics for Apache Spark article within the IBM Cloud platform blog.