[jira] [Created] (MAHOUT-1955) Viennacl jars are not being picked up by the shell startup script

[Andrew Palumbo (JIRA)]

Andrew Palumbo created MAHOUT-1955:
--------------------------------------

Summary: Viennacl jars are not being picked up by the shell startup script
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0


When building for ViennaCL for OpenCL or OpenMP:
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}

The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[Andrew Palumbo (JIRA)]

[ https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1955:
-----------------------------------
Sprint: Jan/Feb-2017

Post by Andrew Palumbo (JIRA)
Viennacl jars are not being picked up by the shell startup script
-----------------------------------------------------------------
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}
The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[Andrew Palumbo (JIRA)]

[ https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on MAHOUT-1955 started by Andrew Palumbo.
----------------------------------------------

Post by Andrew Palumbo (JIRA)
Viennacl jars are not being picked up by the shell startup script
-----------------------------------------------------------------
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}
The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[ASF GitHub Bot (JIRA)]

[ https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15927597#comment-15927597 ]

ASF GitHub Bot commented on MAHOUT-1955:
----------------------------------------

GitHub user andrewpalumbo opened a pull request:

https://github.com/apache/mahout/pull/294

[MAHOUT-1955]: ViennaCL jars are not being picked up by the shell startup script

As reported by Nikolai Sakharnykh, ViennaCL jars were not being picked up by the shell:

After building with `mvn clean install -Pviennacl -Phadoop2`

launching the shell with:

`MASTER=local[4] mahout spark-shell`

and loading launching: `scala> timeSparseDRMMMul(1000,1000,1000,1,.02,1234L)`

```17/03/15 09:36:17 INFO RootSolverFactory$: Creating org.apache.mahout.viennacl.opencl.GPUMMul solver

17/03/15 09:36:17 INFO RootSolverFactory$: Unable to create class GPUMMul: attempting OpenMP version

17/03/15 09:36:17 INFO RootSolverFactory$: Creating org.apache.mahout.viennacl.openmp.OMPMMul solver

17/03/15 09:36:17 INFO RootSolverFactory$: org.apache.mahout.viennacl.openmp.OMPMMul$

17/03/15 09:36:17 INFO RootSolverFactory$: Unable to create class OMPMMul: falling back to java version```

Issue is that `mahout-native-viennacl_2.10` and `mahout-native-viennacl-omp_2.10` were not being copied to the `$MAHOUT_HOME` base dir, and thus not being picked up by `load-shell.sh`.

By modifying the poms to copy jars to the base dir. This problem is fixed:
```
MASTER=local[4] mahout spark-shell
{...}
17/03/16 00:01:27 INFO backend.RootSolverFactory$: Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
17/03/16 00:01:27 INFO backend.RootSolverFactory$: Successfully created org.apache.mahout.viennacl.opencl.GPUMMul solver
17/03/16 00:01:27 INFO opencl.GPUMMul$: Using gpuRWCW method
{...}

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/andrewpalumbo/mahout MAHOUT-1955b

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/294.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #294

----
commit 0e549333bc715e2783c067b2ed34b77ae046edb7
Author: Andrew Palumbo <***@apache.org>
Date: 2017-03-16T06:21:26Z

[MAHOUT-1955] ViennaCL jars are not being picked up by the shell startup script

----

Post by Andrew Palumbo (JIRA)
Viennacl jars are not being picked up by the shell startup script
-----------------------------------------------------------------
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}
The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[ASF GitHub Bot (JIRA)]

[ https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930949#comment-15930949 ]

ASF GitHub Bot commented on MAHOUT-1955:
----------------------------------------

Github user asfgit closed the pull request at:

https://github.com/apache/mahout/pull/294

Post by Andrew Palumbo (JIRA)
Viennacl jars are not being picked up by the shell startup script
-----------------------------------------------------------------
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}
The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[Hudson (JIRA)]

[ https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930972#comment-15930972 ]

Hudson commented on MAHOUT-1955:
--------------------------------

SUCCESS: Integrated in Jenkins build Mahout-Quality #3451 (See [https://builds.apache.org/job/Mahout-Quality/3451/])
[MAHOUT-1955] ViennaCL jars are not being picked up by the shell startup (apalumbo: rev 049619464145feb44805877cea337a4d84179083)
* (edit) viennacl-omp/pom.xml
* (edit) viennacl/pom.xml

Post by Andrew Palumbo (JIRA)
Viennacl jars are not being picked up by the shell startup script
-----------------------------------------------------------------
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}
The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[Andrew Palumbo (JIRA)]

[ https://issues.apache.org/jira/browse/MAHOUT-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo resolved MAHOUT-1955.
------------------------------------
Resolution: Fixed

committeed to master

Post by Andrew Palumbo (JIRA)
Viennacl jars are not being picked up by the shell startup script
-----------------------------------------------------------------
Key: MAHOUT-1955
URL: https://issues.apache.org/jira/browse/MAHOUT-1955
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.13.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
{code}
or
{code}
$ mvn clean install -Pviennacl-omp -Phadoop2 -DskipTests
{code}
The {{mahout-native-*_2.10.jar}} s are not being picked up by the shell which are now in the top-level directory after the build. Fix is to add a copy plugin to the {{viennacl}} and {{viennacl-omp}} {{pom.xml}} s.

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)