Discussion:
[jira] [Created] (MAHOUT-1911) Fix Create Mahout Context after VCL Merge
Andrew Palumbo (JIRA)
2017-01-26 02:50:26 UTC
Permalink
Andrew Palumbo created MAHOUT-1911:
--------------------------------------

Summary: Fix Create Mahout Context after VCL Merge
Key: MAHOUT-1911
URL: https://issues.apache.org/jira/browse/MAHOUT-1911
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo
Priority: Blocker


While the VCL bindings were under development I commented out a large section of {{getMahoutContext()}} in {{SparkBindings/package.scala}}

This code has been changed slightly so need to make sure it is replaced and working after rebasing and merging VCL.

I.e.:

{code}
// context specific jars
val mcjars = findMahoutContextJars(closeables)

if (log.isDebugEnabled) {
log.debug("Mahout jars:")
mcjars.foreach(j => log.debug(j))
}

sparkConf.setJars(jars = mcjars.toSeq ++ customJars)
if (!(customJars.size > 0)) sparkConf.setJars(customJars.toSeq)

} else {
// In local mode we don't care about jars, do we?
sparkConf.setJars(customJars.toSeq

{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Andrew Palumbo (JIRA)
2017-01-26 02:50:26 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1911:
-----------------------------------
Fix Version/s: 0.13.0
Post by Andrew Palumbo (JIRA)
Fix Create Mahout Context after VCL Merge
-----------------------------------------
Key: MAHOUT-1911
URL: https://issues.apache.org/jira/browse/MAHOUT-1911
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
While the VCL bindings were under development I commented out a large section of {{getMahoutContext()}} in {{SparkBindings/package.scala}}
This code has been changed slightly so need to make sure it is replaced and working after rebasing and merging VCL.
{code}
// context specific jars
val mcjars = findMahoutContextJars(closeables)
if (log.isDebugEnabled) {
log.debug("Mahout jars:")
mcjars.foreach(j => log.debug(j))
}
sparkConf.setJars(jars = mcjars.toSeq ++ customJars)
if (!(customJars.size > 0)) sparkConf.setJars(customJars.toSeq)
} else {
// In local mode we don't care about jars, do we?
sparkConf.setJars(customJars.toSeq
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Andrew Palumbo (JIRA)
2017-01-26 02:50:26 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo reassigned MAHOUT-1911:
--------------------------------------

Assignee: Andrew Palumbo
Post by Andrew Palumbo (JIRA)
Fix Create Mahout Context after VCL Merge
-----------------------------------------
Key: MAHOUT-1911
URL: https://issues.apache.org/jira/browse/MAHOUT-1911
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
While the VCL bindings were under development I commented out a large section of {{getMahoutContext()}} in {{SparkBindings/package.scala}}
This code has been changed slightly so need to make sure it is replaced and working after rebasing and merging VCL.
{code}
// context specific jars
val mcjars = findMahoutContextJars(closeables)
if (log.isDebugEnabled) {
log.debug("Mahout jars:")
mcjars.foreach(j => log.debug(j))
}
sparkConf.setJars(jars = mcjars.toSeq ++ customJars)
if (!(customJars.size > 0)) sparkConf.setJars(customJars.toSeq)
} else {
// In local mode we don't care about jars, do we?
sparkConf.setJars(customJars.toSeq
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Hudson (JIRA)
2017-02-02 23:08:51 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850704#comment-15850704 ]

Hudson commented on MAHOUT-1911:
--------------------------------

SUCCESS: Integrated in Jenkins build Mahout-Quality #3414 (See [https://builds.apache.org/job/Mahout-Quality/3414/])
[MAHOUT-1934],[MAHOUT-1911]: Clean up getMahoutContext() and surroundnig (apalumbo: rev 991583abf6534a0a7118bfea3af60bf3170397d3)
* (edit) spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala
Post by Andrew Palumbo (JIRA)
Fix Create Mahout Context after VCL Merge
-----------------------------------------
Key: MAHOUT-1911
URL: https://issues.apache.org/jira/browse/MAHOUT-1911
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
While the VCL bindings were under development I commented out a large section of {{getMahoutContext()}} in {{SparkBindings/package.scala}}
This code has been changed slightly so need to make sure it is replaced and working after rebasing and merging VCL.
{code}
// context specific jars
val mcjars = findMahoutContextJars(closeables)
if (log.isDebugEnabled) {
log.debug("Mahout jars:")
mcjars.foreach(j => log.debug(j))
}
sparkConf.setJars(jars = mcjars.toSeq ++ customJars)
if (!(customJars.size > 0)) sparkConf.setJars(customJars.toSeq)
} else {
// In local mode we don't care about jars, do we?
sparkConf.setJars(customJars.toSeq
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-02 23:12:52 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on MAHOUT-1911 started by Andrew Palumbo.
----------------------------------------------
Post by Andrew Palumbo (JIRA)
Fix Create Mahout Context after VCL Merge
-----------------------------------------
Key: MAHOUT-1911
URL: https://issues.apache.org/jira/browse/MAHOUT-1911
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
While the VCL bindings were under development I commented out a large section of {{getMahoutContext()}} in {{SparkBindings/package.scala}}
This code has been changed slightly so need to make sure it is replaced and working after rebasing and merging VCL.
{code}
// context specific jars
val mcjars = findMahoutContextJars(closeables)
if (log.isDebugEnabled) {
log.debug("Mahout jars:")
mcjars.foreach(j => log.debug(j))
}
sparkConf.setJars(jars = mcjars.toSeq ++ customJars)
if (!(customJars.size > 0)) sparkConf.setJars(customJars.toSeq)
} else {
// In local mode we don't care about jars, do we?
sparkConf.setJars(customJars.toSeq
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-02 23:13:51 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo resolved MAHOUT-1911.
------------------------------------
Resolution: Fixed
Post by Andrew Palumbo (JIRA)
Fix Create Mahout Context after VCL Merge
-----------------------------------------
Key: MAHOUT-1911
URL: https://issues.apache.org/jira/browse/MAHOUT-1911
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
While the VCL bindings were under development I commented out a large section of {{getMahoutContext()}} in {{SparkBindings/package.scala}}
This code has been changed slightly so need to make sure it is replaced and working after rebasing and merging VCL.
{code}
// context specific jars
val mcjars = findMahoutContextJars(closeables)
if (log.isDebugEnabled) {
log.debug("Mahout jars:")
mcjars.foreach(j => log.debug(j))
}
sparkConf.setJars(jars = mcjars.toSeq ++ customJars)
if (!(customJars.size > 0)) sparkConf.setJars(customJars.toSeq)
} else {
// In local mode we don't care about jars, do we?
sparkConf.setJars(customJars.toSeq
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Loading...