Discussion:
[jira] [Created] (MAHOUT-1902) Parse Spark and Mahout variable arguments from the Mahout spark-shell
Andrew Palumbo (JIRA)
2017-01-09 18:20:58 UTC
Permalink
Andrew Palumbo created MAHOUT-1902:
--------------------------------------

Summary: Parse Spark and Mahout variable arguments from the Mahout spark-shell
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Fix For: 1.0.0, 0.13.0, 0.14.0


The {{Spark spark-shell}} allows for spark variables to be supplied at the command line, e.g.:

{code}
spark-shell -Dspark.executor.memory=4g
{code}

The mahout shell does not have an argument parser for CLI vars. We should allow for variables to be set in the same fashion; e.g.:

{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}

This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Suneel Marthi (JIRA)
2017-01-09 18:22:58 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suneel Marthi reassigned MAHOUT-1902:
-------------------------------------

Assignee: Suneel Marthi
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Assignee: Suneel Marthi
Labels: newbie
Fix For: 1.0.0, 0.13.0, 0.14.0
{code}
spark-shell -Dspark.executor.memory=4g
{code}
{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Andrew Palumbo (JIRA)
2017-01-11 02:52:58 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1902:
-----------------------------------
Sprint: Jan/Feb-2017
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Assignee: Suneel Marthi
Labels: newbie
Fix For: 1.0.0, 0.13.0, 0.14.0
{code}
spark-shell -Dspark.executor.memory=4g
{code}
{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Andrew Palumbo (JIRA)
2017-01-16 02:28:28 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1902:
-----------------------------------
Sprint: Jan/Feb-2016 (was: Jan/Feb-2017)
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Assignee: Suneel Marthi
Labels: newbie
Fix For: 1.0.0, 0.13.0, 0.14.0
{code}
spark-shell -Dspark.executor.memory=4g
{code}
{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Andrew Palumbo (JIRA)
2017-01-16 02:28:29 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1902:
-----------------------------------
Sprint: Jan/Feb-2017 (was: Jan/Feb-2016)
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Assignee: Suneel Marthi
Labels: newbie
Fix For: 1.0.0, 0.13.0, 0.14.0
{code}
spark-shell -Dspark.executor.memory=4g
{code}
{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Trevor Grant (JIRA)
2017-02-18 23:14:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873360#comment-15873360 ]

Trevor Grant commented on MAHOUT-1902:
--------------------------------------

This may be solved by MAHOUT-1894
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Labels: newbie
Fix For: 1.0.0, 0.14.0, 0.13.1
{code}
spark-shell -Dspark.executor.memory=4g
{code}
{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Trevor Grant (JIRA)
2017-02-24 14:36:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Trevor Grant resolved MAHOUT-1902.
----------------------------------
Resolution: Fixed
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Labels: newbie
Fix For: 1.0.0, 0.14.0, 0.13.1
{code}
spark-shell --driver-memory 4g
{code}
{code}
mahout spark-shell --driver-memory 4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Trevor Grant (JIRA)
2017-02-24 14:36:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882791#comment-15882791 ]

Trevor Grant commented on MAHOUT-1902:
--------------------------------------

This is in fact solved by MAHOUT-1894
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Labels: newbie
Fix For: 1.0.0, 0.14.0, 0.13.1
{code}
spark-shell --driver-memory 4g
{code}
{code}
mahout spark-shell --driver-memory 4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Trevor Grant (JIRA)
2017-02-24 14:36:44 UTC
Permalink
[ https://issues.apache.org/jira/browse/MAHOUT-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Trevor Grant updated MAHOUT-1902:
---------------------------------
Description:
The {{Spark spark-shell}} allows for spark variables to be supplied at the command line, e.g.:

{code}
spark-shell --driver-memory 4g
{code}

The mahout shell does not have an argument parser for CLI vars. We should allow for variables to be set in the same fashion; e.g.:

{code}
mahout spark-shell --driver-memory 4g
{code}

This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.


was:
The {{Spark spark-shell}} allows for spark variables to be supplied at the command line, e.g.:

{code}
spark-shell -Dspark.executor.memory=4g
{code}

The mahout shell does not have an argument parser for CLI vars. We should allow for variables to be set in the same fashion; e.g.:

{code}
mahout spark-shell -Dspark.executor.memory=4g
{code}

This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
Post by Andrew Palumbo (JIRA)
Parse Spark and Mahout variable arguments from the Mahout spark-shell
---------------------------------------------------------------------
Key: MAHOUT-1902
URL: https://issues.apache.org/jira/browse/MAHOUT-1902
Project: Mahout
Issue Type: Bug
Components: Mahout spark shell
Affects Versions: 0.12.2
Reporter: Andrew Palumbo
Labels: newbie
Fix For: 1.0.0, 0.14.0, 0.13.1
{code}
spark-shell --driver-memory 4g
{code}
{code}
mahout spark-shell --driver-memory 4g
{code}
This would be a good issue for someone who wants to start working on mahout, to get familiar with the codebase.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Loading...