[jira] [Created] (MAHOUT-1705) Pare down job jar for h2o mahout-examples jar

Discussion:

Andrew Palumbo (JIRA)

2015-05-05 15:50:59 UTC

Andrew Palumbo created MAHOUT-1705:
--------------------------------------

Summary: Pare down job jar for h2o mahout-examples jar
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Bug
Reporter: Andrew Palumbo

mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 15:53:00 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Pare down job jar for h2o mahout-examples jar
---------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Bug
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 15:53:00 UTC

Permalink

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 15:53:01 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Pare down job jar for h2o mahout-examples jar
---------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 15:57:00 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1705:
-----------------------------------
Summary: Pare down job jar for mahout-examples jar (was: Pare down job jar for h2o mahout-examples jar)

Pare down job jar for mahout-examples jar
-----------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 15:57:00 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Pare down job jar for mahout-examples
-------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 19:42:00 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo reassigned MAHOUT-1705:
--------------------------------------

Assignee: Andrew Palumbo

Post by Andrew Palumbo (JIRA)
Pare down job jar for mahout-examples
-------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 21:09:00 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529277#comment-14529277 ]

Andrew Palumbo commented on MAHOUT-1705:
----------------------------------------

I'm wondering if it would make more sense to just keep all of the dependencies in the examples jar and ship that in the release as is and remove the {{/lib}} directory. This seems to be what {{/bin/mahout}} is setup for.

Post by Andrew Palumbo (JIRA)
Pare down job jar for mahout-examples
-------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-05 21:14:02 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529277#comment-14529277 ]

Andrew Palumbo edited comment on MAHOUT-1705 at 5/5/15 9:14 PM:
----------------------------------------------------------------

I'm wondering if it would make more sense to just keep all of the dependencies in the examples jar and ship that in the release as (with some tweaks) is and remove the {{/lib}} directory. This seems to be what {{/bin/mahout}} is setup for.

was (Author: andrew_palumbo):
I'm wondering if it would make more sense to just keep all of the dependencies in the examples jar and ship that in the release as is and remove the {{/lib}} directory. This seems to be what {{/bin/mahout}} is setup for.

Post by Andrew Palumbo (JIRA)
Pare down job jar for mahout-examples
-------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-06 21:20:01 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1705:
-----------------------------------
Description: mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant. (was: mahout-example-*-job.jar is around ~56M, and packages redundant libraries and transitive dependencies. )

Post by Andrew Palumbo (JIRA)
Pare down job jar for mahout-examples
-------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-06 21:21:01 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Palumbo updated MAHOUT-1705:
-----------------------------------
Summary: Verify dependencies in job jar for mahout-examples (was: Pare down job jar for mahout-examples)

Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-05-06 21:21:01 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Fix For: 0.10.1, 0.11.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2015-05-31 04:33:17 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suneel Marthi updated MAHOUT-1705:
----------------------------------
Assignee: Andrew Palumbo

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.11.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2015-05-31 04:33:17 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.11.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Musselman (JIRA)

2015-11-05 00:47:27 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990814#comment-14990814 ]

Andrew Musselman commented on MAHOUT-1705:
------------------------------------------

Needs more discussion?

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.11.1
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-11-05 02:35:27 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 1.0.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2015-11-05 02:41:27 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991003#comment-14991003 ]

Andrew Palumbo commented on MAHOUT-1705:
----------------------------------------

Yeah- it may be as simple as removing the /lib directory- needs to be revisited.. we should discuss the possibility removing "MAHOUT_LOCAL" at some point and limiting the scope of the dependencies to "provided". Not pressing for 0.11.1 so I've moved it to 1.0.0. Not sure if that is right.

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 1.0.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2015-11-05 03:34:27 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991062#comment-14991062 ]

Suneel Marthi commented on MAHOUT-1705:
---------------------------------------

Lets fix this for the next 0.12.0 release.

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 1.0.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2016-03-17 17:42:33 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15200012#comment-15200012 ]

Suneel Marthi commented on MAHOUT-1705:
---------------------------------------

Assigning this to [~andrew.musselman], we need to resolve this in 0.12.0

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Palumbo
Fix For: 0.12.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2016-03-17 17:42:33 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
Fix For: 0.12.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2016-03-17 17:42:33 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
Fix For: 0.12.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Musselman (JIRA)

2016-03-18 19:54:33 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Musselman updated MAHOUT-1705:
-------------------------------------
Fix Version/s: (was: 0.12.0)
0.12.1

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
Fix For: 0.12.1
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Musselman (JIRA)

2016-03-21 19:45:25 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Musselman resolved MAHOUT-1705.
--------------------------------------
Resolution: Later
Fix Version/s: (was: 0.12.1)

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Musselman

2016-03-21 20:09:30 UTC

Permalink

Yeah it's interesting people have been using it to avoid running a Hadoop
cluster :)

Good call on the user survey!
-------- Original message --------
Date: 03/21/2016 3:45 PM (GMT-05:00)
Subject: [jira] [Resolved] (MAHOUT-1705) Verify dependencies in job jar
for mahout-examples
[
https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Musselman resolved MAHOUT-1705.
--------------------------------------
Resolution: Later
Fix Version/s: (was: 0.12.1)

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
mahout-example-*-job.jar is around ~56M, and may package unused runtime

libraries. We need to go through this and make sure that there is nothing
unneeded or redundant.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2016-04-28 02:40:12 UTC

Permalink

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
Fix For: 0.12.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Suneel Marthi (JIRA)

2016-04-28 02:40:12 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suneel Marthi closed MAHOUT-1705.
---------------------------------

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
Fix For: 0.12.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Andrew Palumbo (JIRA)

2016-09-06 21:23:20 UTC

Permalink

[ https://issues.apache.org/jira/browse/MAHOUT-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468602#comment-15468602 ]

Andrew Palumbo commented on MAHOUT-1705:
----------------------------------------

This should be reopened since MAHOUT_LOCAL support has already begun to be been phased out, and looks like its getting official votes on the list. That in conjunction with the dropping of Hadoop1 support should allow for alot of dependencies to Go int the {{<provided>}} scope, and help us get the size down.

Post by Andrew Palumbo (JIRA)
Verify dependencies in job jar for mahout-examples
--------------------------------------------------
Key: MAHOUT-1705
URL: https://issues.apache.org/jira/browse/MAHOUT-1705
Project: Mahout
Issue Type: Improvement
Affects Versions: 0.10.0
Reporter: Andrew Palumbo
Assignee: Andrew Musselman
Fix For: 0.12.0
mahout-example-*-job.jar is around ~56M, and may package unused runtime libraries. We need to go through this and make sure that there is nothing unneeded or redundant.

--
This message was sent by Atlassian JIRA
(v6.3.4#6332)