[jira] [Created] (MAHOUT-1934) OpenMP jars aren't being picked up in distributed Spark

Discussion:

Trevor Grant (JIRA)

2017-02-02 15:05:52 UTC

Trevor Grant created MAHOUT-1934:
------------------------------------

Summary: OpenMP jars aren't being picked up in distributed Spark
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Fix For: 0.13.0

When executing the following:

```
import org.apache.mahout.math.decompositions._

drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```

I see the following:
```
import org.apache.mahout.math.decompositions._
res1: org.apache.mahout.math.drm.CheckpointedDrm[Int] = ***@2e8dd198
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```

The code executes fine, but it seems the OpenMP is not getting picked up.

To be clear I build these jars with -Pviennacl-omp

I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Andrew Palumbo (JIRA)

2017-02-02 18:42:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850297#comment-15850297 ]

Andrew Palumbo commented on MAHOUT-1934:
----------------------------------------

Thanks - will look into this later today.

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Andrew Palumbo (JIRA)

2017-02-02 21:01:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on MAHOUT-1934 started by Andrew Palumbo.
----------------------------------------------

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Andrew Palumbo (JIRA)

2017-02-02 21:02:52 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1934:
-----------------------------------
Priority: Blocker (was: Major)

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Andrew Palumbo (JIRA)

2017-02-02 21:28:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850541#comment-15850541 ]

Andrew Palumbo commented on MAHOUT-1934:
----------------------------------------

ok so VCL jars are picked up in {{mahout-shell in local}} mode:

{code}
$MASTER=local[2] mahout spark-shell

mahout> :load /home/andy/sandbox/mahout/examples/bin/SparseSparseDrmTimer.mscala
Loading /home/andy/sandbox/mahout/examples/bin/SparseSparseDrmTimer.mscala...
timeSparseDRMMMul: (m: Int, n: Int, s: Int, para: Int, pctDense: Double, seed: Long)Long
mahout> timeSparseDRMMMul(500, 500, 500, 10)
[Stage 2:=============================> (5 + 2) / 10][INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
[INFO] Successfully created org.apache.mahout.viennacl.openmp.OMPMMul solver
[INFO] Successfully created org.apache.mahout.viennacl.openmp.OMPMMul solver
ompRWCW
ompRWCW
{code}

the {{ompRWCW}} "trace" (println) is confirmation that the Drm Matrix Multiplication is executed by OpenMP.

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

ASF GitHub Bot (JIRA)

2017-02-02 22:16:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850598#comment-15850598 ]

ASF GitHub Bot commented on MAHOUT-1934:
----------------------------------------

GitHub user andrewpalumbo opened a pull request:

https://github.com/apache/mahout/pull/272

[MAHOUT-1934],[MAHOUT-1911] uncomment spark jar loading from VCL development

In Spark `MASTER=local[*]` mode this fixes the pickup of viennacl-jars.. trying with a Standalone cluster.. Would like to push this thouh now as it may fix the broken build. If not a new Bug may have been introduced outside of VCL bindings.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/andrewpalumbo/mahout MAHOUT-1934

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/272.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #272

----

----

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

ASF GitHub Bot (JIRA)

2017-02-02 22:23:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850612#comment-15850612 ]

ASF GitHub Bot commented on MAHOUT-1934:
----------------------------------------

Github user asfgit closed the pull request at:

https://github.com/apache/mahout/pull/272

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Hudson (JIRA)

2017-02-02 23:07:52 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850703#comment-15850703 ]

Hudson commented on MAHOUT-1934:
--------------------------------

SUCCESS: Integrated in Jenkins build Mahout-Quality #3414 (See [https://builds.apache.org/job/Mahout-Quality/3414/])
[MAHOUT-1934],[MAHOUT-1911]: Clean up getMahoutContext() and surroundnig (apalumbo: rev 991583abf6534a0a7118bfea3af60bf3170397d3)
* (edit) spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

ASF GitHub Bot (JIRA)

2017-02-03 01:31:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850887#comment-15850887 ]

ASF GitHub Bot commented on MAHOUT-1934:
----------------------------------------

GitHub user andrewpalumbo opened a pull request:

https://github.com/apache/mahout/pull/273

MAHOUT-1934: OpenMP jars aren't being picked up

add in dependency-reduced.jar to put javacpp jars on executor classpath. Hack for now. use simple wildcard as well.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/andrewpalumbo/mahout MAHOUT-1934b

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/273.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #273

----
commit 892f570b879ccdedd59ad03eb6690da661b90f2c
Author: Andrew Palumbo <***@apache.org>
Date: 2017-02-03T01:29:15Z

MAHOUT-1934: OpenMP jars aren't being picked up add in dependency-reduced.jar to put javacpp jars on executor classpath. Hack for now.

----

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

ASF GitHub Bot (JIRA)

2017-02-03 01:33:52 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850888#comment-15850888 ]

ASF GitHub Bot commented on MAHOUT-1934:
----------------------------------------

Github user asfgit closed the pull request at:

https://github.com/apache/mahout/pull/273

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Hudson (JIRA)

2017-02-03 02:23:51 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850948#comment-15850948 ]

Hudson commented on MAHOUT-1934:
--------------------------------

SUCCESS: Integrated in Jenkins build Mahout-Quality #3415 (See [https://builds.apache.org/job/Mahout-Quality/3415/])
MAHOUT-1934: OpenMP jars aren't being picked up add in (apalumbo: rev 22c5e86480c124c95b2a4698e23a0d98cd7a474b)
* (edit) spark/src/main/scala/org/apache/mahout/sparkbindings/package.scala

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Andrew Palumbo (JIRA)

2017-02-25 22:15:44 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884407#comment-15884407 ]

Andrew Palumbo commented on MAHOUT-1934:
----------------------------------------

[~rawkintrevo] this is good to go correct?

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Andrew Palumbo (JIRA)

2017-02-26 00:38:45 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo resolved MAHOUT-1934.
------------------------------------
Resolution: Fixed

Evidince of this fix has been observed.

Post by Trevor Grant (JIRA)
OpenMP jars aren't being picked up in distributed Spark
-------------------------------------------------------
Key: MAHOUT-1934
URL: https://issues.apache.org/jira/browse/MAHOUT-1934
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.13.0
Reporter: Trevor Grant
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
```
import org.apache.mahout.math.decompositions._
drmX.checkpoint()
val (U, V, s) = dspca(drmX, k = 30, q = 1)
```
```
import org.apache.mahout.math.decompositions._
[INFO] Creating org.apache.mahout.viennacl.opencl.GPUMMul solver
[WARN] Unable to create class GPUMMul: attempting OpenMP version
[INFO] Creating org.apache.mahout.viennacl.openmp.OMPMMul solver
org.apache.mahout.viennacl.openmp.OMPMMul$
[INFO] Unable to create class OMPMMul: falling back to java version
drmReduxX: org.apache.mahout.math.drm.DrmLike[Int] =
OpMapBlock(OpTimesRightMatrix(org.apache.mahout.s...
```
The code executes fine, but it seems the OpenMP is not getting picked up.
To be clear I build these jars with -Pviennacl-omp
I the issue persists through other operations as well. I am running on a 3 node Yarn cluster/ spark 1.6.3

--
This message was sent by Atlassian JIRA
(v6.3.15#6346)