Discussion:
[jira] [Created] (MAHOUT-1938) When building on linux, haswell properties are not working.
Andrew Palumbo (JIRA)
2017-02-05 07:12:42 UTC
Permalink
Andrew Palumbo created MAHOUT-1938:
--------------------------------------

Summary: When building on linux, haswell properties are not working.
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0


got a failure when building on linux with haswell.properties:

{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s

{code}

Need to fix



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-06 18:21:41 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854479#comment-15854479 ]

Andrew Palumbo commented on MAHOUT-1938:
----------------------------------------

this may have been run for the wrong version of gcc.
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-26 01:19:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo reassigned MAHOUT-1938:
--------------------------------------

Assignee: Andrew Palumbo
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-26 01:19:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on MAHOUT-1938 started by Andrew Palumbo.
----------------------------------------------
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-26 02:37:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884495#comment-15884495 ]

Andrew Palumbo commented on MAHOUT-1938:
----------------------------------------

Compilation passes on my AMD machine..
however at runtime, the library shows up as not available:

{code}
$ mvn clean install -Pviennacl -Phadoop2 -DskipTests
$ cd spark && mvn test

{...}

Warning: Could not load platform properties for class org.apache.mahout.viennacl.opencl.GPUMMul
Warning: Could not load platform properties for class org.apache.mahout.viennacl.opencl.GPUMMul$
Generating /home/andy/sandbox/mahout/viennacl/target/classes/org/apache/mahout/viennacl/opencl/javacpp/jniViennaCL.cpp
Compiling /home/andy/sandbox/mahout/viennacl/target/classes/org/apache/mahout/viennacl/opencl/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/home/andy/java/jdk1.8.0_111/include -I/home/andy/java/jdk1.8.0_111/include/linux /home/andy/sandbox/mahout/viennacl/target/classes/org/apache/mahout/viennacl/opencl/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
Deleting /home/andy/sandbox/mahout/viennacl/target/classes/org/apache/mahout/viennacl/opencl/javacpp/jniViennaCL.cpp

{...}
*** RUN ABORTED ***
java.lang.UnsatisfiedLinkError: no jniViennaCL in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:727)
at org.bytedeco.javacpp.Loader.load(Loader.java:502)
at org.bytedeco.javacpp.Loader.load(Loader.java:435)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.<init>(Context.scala:65)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.<clinit>(Context.scala)
at org.apache.mahout.opencl.viennacl.ViennaCLSuiteVCL$$anonfun$1.apply$mcV$sp(ViennaCLSuiteVCL.scala:36)
...
Cause: java.lang.UnsatisfiedLinkError: no OpenCL in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:727)
at org.bytedeco.javacpp.Loader.load(Loader.java:493)
at org.bytedeco.javacpp.Loader.load(Loader.java:435)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.<init>(Context.scala:65)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.<clinit>(Context.scala)
at org.apache.mahout.opencl.viennacl.ViennaCLSuiteVCL$$anonfun$1.apply$mcV$sp(ViennaCLSuiteVCL.scala:36)
{code}

Likely nothing is wrong with the compilation, but does not fall back to AMD instruction set obviously. My hope was that it would fall back to at least the Intel Instruction set so that we could put out a single version. for (Intel/haswell).
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
ASF GitHub Bot (JIRA)
2017-02-26 02:41:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884498#comment-15884498 ]

ASF GitHub Bot commented on MAHOUT-1938:
----------------------------------------

GitHub user andrewpalumbo opened a pull request:

https://github.com/apache/mahout/pull/284

MAHOUT-1938: Switch to Intel AVX 2 instruction set

A question that we may need to consider- do we want to release the binaries for AVX2? There does not seem to be a fall-back to AMD arch.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/andrewpalumbo/mahout MAHOUT-1938

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/mahout/pull/284.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #284

----
commit abf6d529fc146a90308848e304960fe60dfc0917
Author: Andrew Palumbo <***@apache.org>
Date: 2017-02-26T02:37:49Z

MAHOUT-1938: Switch to Intel AVX 2 instruction set

----
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
ASF GitHub Bot (JIRA)
2017-02-26 02:42:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884499#comment-15884499 ]

ASF GitHub Bot commented on MAHOUT-1938:
----------------------------------------

Github user andrewpalumbo commented on the issue:

https://github.com/apache/mahout/pull/284

@andrewmusselman could you test this patch out so that wee can ensure that It works on Haswell?
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
ASF GitHub Bot (JIRA)
2017-02-26 02:43:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884500#comment-15884500 ]

ASF GitHub Bot commented on MAHOUT-1938:
----------------------------------------

Github user andrewpalumbo commented on the issue:

https://github.com/apache/mahout/pull/284

Could someone with an Intel chipset pre-Haswell (most i-7s) test this to ensure that it does have a fallback to non-avx2 instruction sets?
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-26 05:36:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884552#comment-15884552 ]

Andrew Palumbo commented on MAHOUT-1938:
----------------------------------------

On both AVX2 machines and i7 with out AVX2 same error: looks like library is getting lost in the build.

{code}
ViennaCLSuiteVCL:
*** RUN ABORTED ***
java.lang.UnsatisfiedLinkError: no jniViennaCL in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at org.bytedeco.javacpp.Loader.loadLibrary(Loader.java:727)
at org.bytedeco.javacpp.Loader.load(Loader.java:502)
at org.bytedeco.javacpp.Loader.load(Loader.java:435)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.loadLib(Context.scala:63)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.<init>(Context.scala:65)
at org.apache.mahout.viennacl.opencl.javacpp.Context$.<clinit>(Context.scala)
at org.apache.mahout.opencl.viennacl.ViennaCLSuiteVCL$$anonfun$1.apply$mcV$sp(ViennaCLSuiteVCL.scala:36)
{code}
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-26 06:34:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884574#comment-15884574 ]

Andrew Palumbo commented on MAHOUT-1938:
----------------------------------------

adjusting line one of {{linux-haswell.properties}} from:
{{platform=linux-haswell}}
to
{{platform=linux-x86_64}}

allows the jvm to find the jni lib hardcoded at:
{code}
<LD_LIBRARY_PATH>{project.basedir}/target/classes/org/apache/mahout/javacpp/linalg/linux-x86_64/
{code}

in {{viennacl/pom.xml}}

On an AMD machine viennacl tests crash with a segfault now:

{code}
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGILL (0x4) at pc=0x00007fdb70907de7, pid=21538, tid=0x00007fdb8b51e700
#
# JRE version: Java(TM) SE Runtime Environment (8.0_111-b14) (build 1.8.0_111-b14)
# Java VM: Java HotSpot(TM) 64-Bit Server VM (25.111-b14 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C [libjniViennaCL.so+0x9bde7] viennacl::matrix_base<double, unsigned long, long>::matrix_base(unsigned long, unsigned long, bool, viennacl::context)+0x67
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# An error report file with more information is saved as:
# /home/andy/sandbox/mahout/viennacl/hs_err_pid21538.log
#
{code}
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
ASF GitHub Bot (JIRA)
2017-02-26 06:44:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884579#comment-15884579 ]

ASF GitHub Bot commented on MAHOUT-1938:
----------------------------------------

Github user andrewpalumbo commented on the issue:

https://github.com/apache/mahout/pull/284

build line:
`mvn clean install -Pviennacl -Phadoop2 -DskipTests && cd viennacl && mvn test`
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
ASF GitHub Bot (JIRA)
2017-02-26 22:01:45 UTC
Permalink
This post might be inappropriate. Click to display it.
ASF GitHub Bot (JIRA)
2017-02-27 02:20:45 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885040#comment-15885040 ]

ASF GitHub Bot commented on MAHOUT-1938:
----------------------------------------

Github user asfgit closed the pull request at:

https://github.com/apache/mahout/pull/284
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Andrew Palumbo (JIRA)
2017-02-27 02:34:46 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo resolved MAHOUT-1938.
------------------------------------
Resolution: Fixed
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Hudson (JIRA)
2017-02-27 02:57:45 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885056#comment-15885056 ]

Hudson commented on MAHOUT-1938:
--------------------------------

FAILURE: Integrated in Jenkins build Mahout-Quality #3427 (See [https://builds.apache.org/job/Mahout-Quality/3427/])
MAHOUT-1938: When building on linux, haswell properties are not working. (apalumbo: rev 51b1ab99a86311078aa205f32ad178acdb824fc9)
* (edit) viennacl-omp/linux-haswell.properties
* (edit) viennacl-omp/pom.xml
* (edit) viennacl/linux-haswell.properties
Post by Andrew Palumbo (JIRA)
When building on linux, haswell properties are not working.
-----------------------------------------------------------
Key: MAHOUT-1938
URL: https://issues.apache.org/jira/browse/MAHOUT-1938
Project: Mahout
Issue Type: Bug
Affects Versions: 0.12.1
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Priority: Blocker
Fix For: 0.13.0
{code}
Warning: Could not load platform properties for class org.apache.mahout.viennacl.openmp.OMPMMul$
Generating /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp
Compiling /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/linux-haswell/libjniViennaCL.so
g++ -I/usr/include/viennacl -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include -I/usr/lib/jvm/java-1.7.0-openjdk-1.7.0.121.x86_64/include/linux /vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp -msse3 -ffast-math -fopenmp -fpermissive -Wl,-rpath,$ORIGIN/ -Wl,-z,noexecstack -Wl,-Bsymbolic -march=haswell -m64 -Wall -O3 -fPIC -shared -s -o libjniViennaCL.so -lOpenCL
/vol0/mahout/viennacl-omp/target/classes/org/apache/mahout/viennacl/openmp/javacpp/jniViennaCL.cpp:1:0: error: bad value (haswell) for -march= switch
// Generated by JavaCPP version 1.2.4: DO NOT EDIT THIS FILE
^
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.721 s
{code}
Need to fix
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Loading...