MD5 checker Jenkins job

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

MD5 checker Jenkins job

Tom Chiverton-2

The Jenkins job that checks for new MD5s is choking on "verifying checksum" but I can't see where that actually is because it's an out of memory error and crashed in flash.net.URlStream.readBytes


I've just closed it for now...


--
Tom Chiverton
Lead Developer
e:  [hidden email]
p:  0161 817 2922
t:  @extravision
w:  www.extravision.com
Extravision - email worth seeing
Registered in the UK at: 107 Timber Wharf, 33 Worsley Street, Manchester, M15 4LD.
Company Reg No: 0‌‌5017214 VAT: GB 8‌‌24 5386 19

This e-mail is intended solely for the person to whom it is addressed and may contain confidential or privileged information.
Any views or opinions presented in this e-mail are solely of the author and do not necessarily represent those of Extravision Ltd.
Reply | Threaded
Open this post in threaded view
|

Re: MD5 checker Jenkins job

Alex Harui
Hi Tom,

Thanks for noticing that.  Would you like to volunteer to be another MD5Checker "fix-it person"?  I think I'm the only one and it would be great to have someone else help out.  Once we get you up and running, it doesn't take much time.

Whenever the AIR SDK changes, MD5Checker needs to run to update the checksums.  The Jenkins server is too memory constrained to eat an entire AIR SDK so the job chokes and blocks all future Jenkins jobs until someone notices.  Canceling the job manually frees up the other jobs until MD5Checker runs again.

So what I have to do to "fix it" is to run MD5Checker on my own computer.  There is an Ant script that runs MD5Checker and commits the changes to our web-site's SVN.  Then you have to go use ASF CMS to publish the changes.

Thanks,
-Alex

From: Tom Chiverton <[hidden email]<mailto:[hidden email]>>
Reply-To: "[hidden email]<mailto:[hidden email]>" <[hidden email]<mailto:[hidden email]>>
Date: Friday, April 28, 2017 at 2:51 AM
To: "[hidden email]<mailto:[hidden email]>" <[hidden email]<mailto:[hidden email]>>
Subject: MD5 checker Jenkins job


The Jenkins job that checks for new MD5s is choking on "verifying checksum" but I can't see where that actually is because it's an out of memory error and crashed in flash.net.URlStream.readBytes


I've just closed it for now...

--



Tom Chiverton
Lead Developer

e:      [hidden email]<mailto:[hidden email]>
p:      0161 817 2922
t:      @extravision<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fextravision&data=02%7C01%7C%7C664eb883ed474df7b50908d48e1c3021%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636289699100605029&sdata=SwkyiLFTCtEkor5BBh83FQUn6kG31ut4RfcUBrUT0xo%3D&reserved=0>
w:      www.extravision.com<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.extravision.com%2F&data=02%7C01%7C%7C664eb883ed474df7b50908d48e1c3021%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636289699100605029&sdata=miVqjM5vb7LtEd5xEzTiZwvgFMTmmqBks1IeDpo8IwA%3D&reserved=0>


[Extravision - email worth seeing]<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.extravision.com%2F&data=02%7C01%7C%7C664eb883ed474df7b50908d48e1c3021%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636289699100605029&sdata=miVqjM5vb7LtEd5xEzTiZwvgFMTmmqBks1IeDpo8IwA%3D&reserved=0>

Registered in the UK at: 107 Timber Wharf, 33 Worsley Street, Manchester, M15 4LD.
Company Reg No: 0‌‌5017214 VAT: GB 8‌‌24 5386 19

This e-mail is intended solely for the person to whom it is addressed and may contain confidential or privileged information.
Any views or opinions presented in this e-mail are solely of the author and do not necessarily represent those of Extravision Ltd.

Reply | Threaded
Open this post in threaded view
|

Re: MD5 checker Jenkins job

Christofer Dutz
Hi Gyus,

I guess the reason is that the default Ant job tries to read the file into memory. This isn’t needed in order to calculate the md5 hash … If the target used a streaming implementation, it should work with a few KB of memory.

Chris

Am 28.04.17, 16:44 schrieb "Alex Harui" <[hidden email]>:

    Hi Tom,
   
    Thanks for noticing that.  Would you like to volunteer to be another MD5Checker "fix-it person"?  I think I'm the only one and it would be great to have someone else help out.  Once we get you up and running, it doesn't take much time.
   
    Whenever the AIR SDK changes, MD5Checker needs to run to update the checksums.  The Jenkins server is too memory constrained to eat an entire AIR SDK so the job chokes and blocks all future Jenkins jobs until someone notices.  Canceling the job manually frees up the other jobs until MD5Checker runs again.
   
    So what I have to do to "fix it" is to run MD5Checker on my own computer.  There is an Ant script that runs MD5Checker and commits the changes to our web-site's SVN.  Then you have to go use ASF CMS to publish the changes.
   
    Thanks,
    -Alex
   
    From: Tom Chiverton <[hidden email]<mailto:[hidden email]>>
    Reply-To: "[hidden email]<mailto:[hidden email]>" <[hidden email]<mailto:[hidden email]>>
    Date: Friday, April 28, 2017 at 2:51 AM
    To: "[hidden email]<mailto:[hidden email]>" <[hidden email]<mailto:[hidden email]>>
    Subject: MD5 checker Jenkins job
   
   
    The Jenkins job that checks for new MD5s is choking on "verifying checksum" but I can't see where that actually is because it's an out of memory error and crashed in flash.net.URlStream.readBytes
   
   
    I've just closed it for now...
   
    --
   
   
   
    Tom Chiverton
    Lead Developer
   
    e:      [hidden email]<mailto:[hidden email]>
    p:      0161 817 2922
    t:      @extravision<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fextravision&data=02%7C01%7C%7C664eb883ed474df7b50908d48e1c3021%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636289699100605029&sdata=SwkyiLFTCtEkor5BBh83FQUn6kG31ut4RfcUBrUT0xo%3D&reserved=0>
    w:      www.extravision.com<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.extravision.com%2F&data=02%7C01%7C%7C664eb883ed474df7b50908d48e1c3021%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636289699100605029&sdata=miVqjM5vb7LtEd5xEzTiZwvgFMTmmqBks1IeDpo8IwA%3D&reserved=0>
   
   
    [Extravision - email worth seeing]<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.extravision.com%2F&data=02%7C01%7C%7C664eb883ed474df7b50908d48e1c3021%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636289699100605029&sdata=miVqjM5vb7LtEd5xEzTiZwvgFMTmmqBks1IeDpo8IwA%3D&reserved=0>
   
    Registered in the UK at: 107 Timber Wharf, 33 Worsley Street, Manchester, M15 4LD.
    Company Reg No: 0‌‌5017214 VAT: GB 8‌‌24 5386 19
   
    This e-mail is intended solely for the person to whom it is addressed and may contain confidential or privileged information.
    Any views or opinions presented in this e-mail are solely of the author and do not necessarily represent those of Extravision Ltd.
   
   

Reply | Threaded
Open this post in threaded view
|

Re: MD5 checker Jenkins job

Alex Harui


On 4/30/17, 7:44 AM, "Christofer Dutz" <[hidden email]> wrote:

>Hi Gyus,
>
>I guess the reason is that the default Ant job tries to read the file
>into memory. This isn’t needed in order to calculate the md5 hash … If
>the target used a streaming implementation, it should work with a few KB
>of memory.

True.  Volunteers are welcome to work on that as well.  However, my
computer has enough memory to do the job.  Maybe Tom or others can help
out as well.  I've beefed up the Wiki page here [1]

[1]
https://cwiki.apache.org/confluence/display/FLEX/MD5Checker+Instruction+Man
ual

-Alex

Reply | Threaded
Open this post in threaded view
|

Re: MD5 checker Jenkins job

Tom Chiverton-2
Sounds easy.

In the mean time, I think the instance has died ? Can you restart it ?

Tom


On 02/05/17 02:18, Alex Harui wrote:

>
> On 4/30/17, 7:44 AM, "Christofer Dutz" <[hidden email]> wrote:
>
>> Hi Gyus,
>>
>> I guess the reason is that the default Ant job tries to read the file
>> into memory. This isn’t needed in order to calculate the md5 hash … If
>> the target used a streaming implementation, it should work with a few KB
>> of memory.
> True.  Volunteers are welcome to work on that as well.  However, my
> computer has enough memory to do the job.  Maybe Tom or others can help
> out as well.  I've beefed up the Wiki page here [1]
>
> [1]
> https://cwiki.apache.org/confluence/display/FLEX/MD5Checker+Instruction+Man
> ual
>
> -Alex
>
>
> ______________________________________________________________________
> This email has been scanned by the Symantec Email Security.cloud service.
> For more information please visit http://www.symanteccloud.com
> ______________________________________________________________________
>

Reply | Threaded
Open this post in threaded view
|

Re: MD5 checker Jenkins job

Alex Harui


On 5/2/17, 2:07 AM, "Tom Chiverton" <[hidden email]> wrote:

>Sounds easy.
>
>In the mean time, I think the instance has died ? Can you restart it ?

When I looked it appeared to be up, but still stuck on MD5Checker even
though I updated it last night.  It turned out that the ASF CMS didn't
pick up the changes so I had to manually tweak a file and force the
change.  I added instructions on that to the MD5Checker wiki page.

I also added another wiki page about how to restart the Jenkins slaves.  I
posted a link to it on the private list along with login/password.
Hopefully others can help maintain the server.

There are likely to be times this summer when I will be off-the-grid for
extended periods of time, so I want to make sure others can keep this
stuff running.

Thanks for volunteering to help.

-Alex