[jira] [Created] (MAHOUT-1906) Ensure customJars are added to the MahoutContext under certain conditions for spark 1.6+

Discussion:

Andrew Palumbo (JIRA)

2017-01-16 22:21:26 UTC

Andrew Palumbo created MAHOUT-1906:
--------------------------------------

Summary: Ensure customJars are added to the MahoutContext under certain conditions for spark 1.6+
Key: MAHOUT-1906
URL: https://issues.apache.org/jira/browse/MAHOUT-1906
Project: Mahout
Issue Type: Dependency upgrade
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13.0

When creating MahoutContext: if 1.6+ && backend is spark-standalone && addMahoutContextJars = false && customJars.isEmpty() Context creation fails with serialization error on task serialization.

Fix is to ensure that jars are added in this case.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ASF GitHub Bot (JIRA)

2017-01-16 22:29:26 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824668#comment-15824668 ]

ASF GitHub Bot commented on MAHOUT-1906:
----------------------------------------

GitHub user andrewpalumbo opened a pull request:

https://github.com/apache/mahout/pull/268

MAHOUT-1906: Ensure customJars are added to the MahoutContext under c…

…ertain conditions for spark 1.6+

When creating MahoutContext: if 1.6+ && backend is spark-standalone && addMahoutContextJars = false && customJars.isEmpty() Context creation fails with serialization error on task serialization.

Fix is to ensure that jars are added in this case.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/andrewpalumbo/mahout MAHOUT-1906

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/268.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #268

----
commit 76da135dce532d638e1d84614e4b0fe4aded1b75
Author: Andrew Palumbo <***@apache.org>
Date: 2017-01-16T22:26:47Z

MAHOUT-1906: Ensure customJars are added to the MahoutContext under certain conditions for spark 1.6+

----

Post by Andrew Palumbo (JIRA)
Ensure customJars are added to the MahoutContext under certain conditions for spark 1.6+
----------------------------------------------------------------------------------------
Key: MAHOUT-1906
URL: https://issues.apache.org/jira/browse/MAHOUT-1906
Project: Mahout
Issue Type: Dependency upgrade
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.13.0
When creating MahoutContext: if 1.6+ && backend is spark-standalone && addMahoutContextJars = false && customJars.isEmpty() Context creation fails with serialization error on task serialization.
Fix is to ensure that jars are added in this case.