PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Number crunching : New LLR wrapper testing

Author Message
Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 87455 - Posted: 24 Aug 2015 | 20:43:59 UTC

Hi all,

To support the upcoming variable deadlines, I have modified the LLR wrapper to send trickle messages back to the server to report progress of running tasks. It will do this once every 24 hours after a task starts, but only when the task is running. If a task starts running, but is then suspended for some reason for longer than 24 hours, the wrapper will send a trickle as soon as the task resumes.

The wrapper also includes some modifications to make the launch of the LLR binary more reliable (see the end of this thread for details).

You can download builds of the new wrapper from: https://github.com/ibethune/llr_wrapper/tree/master/bin

Please have a go running these under app_info.xml - they should be drop-in replacements for the existing wrappers. Let me know if you see any problems, and if the trickle feature appears to be working. You should see messages every 24 hours (for long-running tasks) logged to the BOINC manager event log like this to confirm that a trickle has been sent

24/08/2015 16:52:12 | PrimeGrid | Sending scheduler request: To send trickle-up message. 24/08/2015 16:52:13 | PrimeGrid | Scheduler request completed


If you are running tasks that take less than 24 hours then you shouldn't see any of these messages, only for longer tasks.

Cheers

- Iain

____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

boinc127
Send message
Joined: 27 Jan 12
Posts: 20
ID: 128545
Credit: 25,088,445
RAC: 0
321 LLR Silver: Earned 100,000 credits (155,590)Cullen LLR Silver: Earned 100,000 credits (149,119)ESP LLR Silver: Earned 100,000 credits (146,589)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (159,085)PPS LLR Silver: Earned 100,000 credits (278,725)PSP LLR Silver: Earned 100,000 credits (185,582)SoB LLR Silver: Earned 100,000 credits (378,095)SR5 LLR Silver: Earned 100,000 credits (169,470)SGS LLR Silver: Earned 100,000 credits (132,961)TRP LLR Silver: Earned 100,000 credits (138,992)Woodall LLR Silver: Earned 100,000 credits (184,163)321 Sieve (suspended) Silver: Earned 100,000 credits (154,911)Generalized Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (151,830)PPS Sieve Turquoise: Earned 5,000,000 credits (5,811,604)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (59,653)TRP Sieve (suspended) Silver: Earned 100,000 credits (122,603)AP 26/27 Amethyst: Earned 1,000,000 credits (1,516,125)GFN Turquoise: Earned 5,000,000 credits (8,067,959)WW Bronze: Earned 10,000 credits (48,000)PSA Turquoise: Earned 5,000,000 credits (7,076,660)
Message 87488 - Posted: 26 Aug 2015 | 3:15:40 UTC

So far the wrapper is functioning normally, although I did manually compile it for FreeBSD 64 bit... so I'm not sure if that really helps very much for the purposes of wrapper testing. I haven't tested the trickle feature yet, but I will do a workunit that will take over 24 hours to complete and allow it to trickle up automatically, and I will pause another workunit and resume it over 24 hours later to see if it will also trickle up.

boinc127
Send message
Joined: 27 Jan 12
Posts: 20
ID: 128545
Credit: 25,088,445
RAC: 0
321 LLR Silver: Earned 100,000 credits (155,590)Cullen LLR Silver: Earned 100,000 credits (149,119)ESP LLR Silver: Earned 100,000 credits (146,589)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (159,085)PPS LLR Silver: Earned 100,000 credits (278,725)PSP LLR Silver: Earned 100,000 credits (185,582)SoB LLR Silver: Earned 100,000 credits (378,095)SR5 LLR Silver: Earned 100,000 credits (169,470)SGS LLR Silver: Earned 100,000 credits (132,961)TRP LLR Silver: Earned 100,000 credits (138,992)Woodall LLR Silver: Earned 100,000 credits (184,163)321 Sieve (suspended) Silver: Earned 100,000 credits (154,911)Generalized Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (151,830)PPS Sieve Turquoise: Earned 5,000,000 credits (5,811,604)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (59,653)TRP Sieve (suspended) Silver: Earned 100,000 credits (122,603)AP 26/27 Amethyst: Earned 1,000,000 credits (1,516,125)GFN Turquoise: Earned 5,000,000 credits (8,067,959)WW Bronze: Earned 10,000 credits (48,000)PSA Turquoise: Earned 5,000,000 credits (7,076,660)
Message 87496 - Posted: 27 Aug 2015 | 3:33:55 UTC
Last modified: 27 Aug 2015 | 3:34:56 UTC

Both tasks successfully sent trickle up messages.

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 87499 - Posted: 27 Aug 2015 | 20:49:21 UTC - in response to Message 87496.

Both tasks successfully sent trickle up messages.


Thanks, saw a trickle from you in the logs!

____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 87510 - Posted: 28 Aug 2015 | 12:42:28 UTC
Last modified: 28 Aug 2015 | 12:42:48 UTC

The new wrapper is now live... see this thread for details.

No further app_info.xml testing is therefore needed!
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 87518 - Posted: 29 Aug 2015 | 11:12:59 UTC

The "Text file busy" problem is still alive in my setup, it appeared immediately as soon as I switched 8-core machine from sieve to SGS.

BOINC llr wrapper (version 7.03) Using Jean Penne's llr (64 bit) execl failed once: Text file busy execl failed twice: Text file busy execl failed once: Text file busy execl failed twice: Text file busy app error: 27648

Further investigation gives something really strange. The problematic executable file is held open by few processes, so why it cannot be executed:
tc@box-382C4ABCFF92:~/.boinc/slots/3$ lsof | grep /3/ 4596 /home/tc/.boinc/projects/www.primegrid.com/primegrid_llr_wrapper_7.03_x86_64-pc-linux-gnu /home/tc/.boinc/slots/3/primegrid_llr 4599 /home/tc/.boinc/slots/2/primegrid_llr /home/tc/.boinc/slots/3/primegrid_llr 5043 /home/tc/.boinc/projects/www.primegrid.com/primegrid_llr_wrapper_7.03_x86_64-pc-linux-gnu /home/tc/.boinc/slots/3/stderr.txt 5043 /home/tc/.boinc/projects/www.primegrid.com/primegrid_llr_wrapper_7.03_x86_64-pc-linux-gnu /home/tc/.boinc/slots/3/boinc_lockfile 5049 /home/tc/.boinc/projects/www.primegrid.com/primegrid_llr_wrapper_7.03_x86_64-pc-linux-gnu /home/tc/.boinc/slots/3/stderr.txt 5049 /home/tc/.boinc/projects/www.primegrid.com/primegrid_llr_wrapper_7.03_x86_64-pc-linux-gnu /home/tc/.boinc/slots/3/boinc_lockfile

Check line 1 and 2: it's held open by the wrapper and LLR executable (???) from previous slot (the path lf LLR clearly shows, and pid of this wrapper is different from second/true one which has current stderr/etc. opened). It may look like nonsense, but it's possible that file was opened long time ago without O_NOINHERIT, handle leaked, and this leaked handle has been kept inherited even after long chain of exec()'s.

I'm completely sure that this problem is some kind of race condition. If will happen only if many jobs are started simultaneously. Since I'm running on ramdisk, slots are prepared and executables are run very fast, and problem arises. Next, when tasks are completed randomly, and only one task at once is started in most cases, it works without problems. Unfortunately, it mean that long tasks are not for me anymore (I have many computers which are rebooted to "zombie mode" for a night, with high probability they'll lose progress during each Boinc startup).

From my point of view, it's unclear it it a problem of wrapper, Boinc or even Linux kernel. A question is why (and how) wrapper opens the executable (it may be hidden in Boinc libraries used by wrapper), but it could be not a wrapper's problem at all due to "previous slot" nonsense. The Boinc itself could leak a handle which is further get inherited thru all these exec chains... Ouch...

For now, I will change kernel from 3.8.13 to 3.8.16 and see what will happen. Also I'll try to check latest Linux beta of Boinc.

JimBProject donor
Honorary cruncher
Send message
Joined: 4 Aug 11
Posts: 917
ID: 107307
Credit: 977,945,376
RAC: 0
Discovered 1 mega prime321 LLR Ruby: Earned 2,000,000 credits (3,327,838)Cullen LLR Turquoise: Earned 5,000,000 credits (5,031,868)ESP LLR Turquoise: Earned 5,000,000 credits (5,064,082)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,038,750)PPS LLR Turquoise: Earned 5,000,000 credits (5,000,461)PSP LLR Turquoise: Earned 5,000,000 credits (7,674,374)SoB LLR Sapphire: Earned 20,000,000 credits (42,604,648)SR5 LLR Jade: Earned 10,000,000 credits (11,829,173)SGS LLR Ruby: Earned 2,000,000 credits (2,537,053)TRP LLR Ruby: Earned 2,000,000 credits (2,291,092)Woodall LLR Turquoise: Earned 5,000,000 credits (5,046,412)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,057,614)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,002,919)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,005,451)PPS Sieve Emerald: Earned 50,000,000 credits (52,042,965)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,341,676)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,070,804)AP 26/27 Jade: Earned 10,000,000 credits (10,742,251)GFN Emerald: Earned 50,000,000 credits (50,000,251)WW Ruby: Earned 2,000,000 credits (2,688,000)PSA Double Gold: Earned 500,000,000 credits (728,547,693)
Message 87519 - Posted: 29 Aug 2015 | 12:15:31 UTC - in response to Message 87518.

If/when this happens again, check to see how many wrappers you have running. It's happening on one of my machines and I seemed to have an extra wrapper executing.

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 87536 - Posted: 30 Aug 2015 | 12:17:41 UTC - in response to Message 87519.

If/when this happens again, check to see how many wrappers you have running. It's happening on one of my machines and I seemed to have an extra wrapper executing.

I've noticed this too today but this is normal. Wrapper forked himself before exec(). When exec() failed, the forked copy sleeps 5 seconds before second attempt. So you have some time (5-seconds) see both wrapper processes - under normal circumstances forked copy immediately disappears (gets replaced by executed program).

Meantime:

1. Look like this problem is very easy to reproduce on 8-cores system just by disabling fetch of new work and re-enabling it again when lot of free cores are available. Boinc will try download lot of new tasks and start them at once (really, on my PC it does in groups by two) - and boom, got today 2 of 5 tasks not started.

2. Update to latest available for download Linux Boinc 7.4.22 didn't help. The only thing left to try is to update kernel.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13835
ID: 53948
Credit: 375,113,310
RAC: 303,929
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,513,946)ESP LLR Turquoise: Earned 5,000,000 credits (7,150,009)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,847,031)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (13,659,368)SGS LLR Turquoise: Earned 5,000,000 credits (5,037,630)TRP LLR Turquoise: Earned 5,000,000 credits (6,308,522)Woodall LLR Turquoise: Earned 5,000,000 credits (6,390,624)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (94,307,251)WW Emerald: Earned 50,000,000 credits (88,532,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 87541 - Posted: 30 Aug 2015 | 14:03:54 UTC - in response to Message 87536.

Boinc will try download lot of new tasks and start them at once (really, on my PC it does in groups by two)


BOINC gets all 8 tasks at once from the server, but each task requires a very small file download.

By default, the BOINC client is set to do only 2 file transfers at once, so that's why you see the tasks starting in pairs.

If you change the settings to do 8 downloads at once, you should see all 8 start at once.

However, in reality, each one is starting as the download completes, and although they'll look like they're starting simultaneously to us, they're not starting at exactly the same time. You would need to download the tasks, suspend execution (without 'keep in memory'), and then resume execution to really get them to start at once.
____________
My lucky number is 75898524288+1

LumiukkoProject donor
Volunteer tester
Send message
Joined: 7 Jul 08
Posts: 165
ID: 25183
Credit: 860,958,011
RAC: 56,067
Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 2 primes in the 2020 Tour de PrimesFound 1 mega prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,479,461)Cullen LLR Jade: Earned 10,000,000 credits (10,977,573)ESP LLR Jade: Earned 10,000,000 credits (10,392,711)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (14,089,784)PPS LLR Sapphire: Earned 20,000,000 credits (22,950,085)PSP LLR Jade: Earned 10,000,000 credits (11,976,669)SoB LLR Sapphire: Earned 20,000,000 credits (37,986,976)SR5 LLR Sapphire: Earned 20,000,000 credits (22,816,836)SGS LLR Jade: Earned 10,000,000 credits (10,253,065)TPS LLR (retired) Bronze: Earned 10,000 credits (22,572)TRP LLR Jade: Earned 10,000,000 credits (13,912,528)Woodall LLR Jade: Earned 10,000,000 credits (12,028,074)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,236,529)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,878,933)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (6,055,601)PPS Sieve Double Bronze: Earned 100,000,000 credits (104,540,791)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,273)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,752,023)AP 26/27 Double Bronze: Earned 100,000,000 credits (102,000,008)GFN Double Bronze: Earned 100,000,000 credits (124,291,007)WW Double Bronze: Earned 100,000,000 credits (101,196,000)PSA Double Silver: Earned 200,000,000 credits (219,103,336)
Message 87547 - Posted: 30 Aug 2015 | 19:24:33 UTC - in response to Message 87541.

...
However, in reality, each one is starting as the download completes...


Note that they will only start if you already have the new executables downloaded.
After PRPNet challenge I changed back to BOINC and saw four tasks downloaded and waiting for the new wrapper and LLR-executable to finish downloading.
After those downloads finished they all started running (almost simultaneously), and 3 out of 4 tasks did not proceed more than about 5 seconds and then restarted (saw 5 wrappers running).


--
Lumiukko

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 87572 - Posted: 31 Aug 2015 | 18:38:34 UTC

I hope I found it. It seem to be a big race condition problem in Boinc.

Unfortunately, when I compiled wrapper myself and used anonymous platform, I wasn't able to reproduce the problem anymore. May be timings has changed. So following is based only on analysis of Boinc source code.

For files greater then 10 megabytes (i.e. LLR) Boinc unconditionally (it cannot be disabled) uses asynchronous copying of files. Since "quality" of Boinc source code is well-known, any sophisticated approach sounds like a trouble. It is. This routine never sets "close-on-exec" flag on opened files. It funny that Boinc insist that wrapper authors should use their boinc_open() function which does set this flag, but their own code does not did this. (btw small race condition still persist even is "safe" function, but the window is really small).

Following is exactly as I expected. The file is copied "in background" in small chunks. If another task have a chance to run when copy is still in progress, it'll inherit these two file handles and lock them. Interesting that same "background" approach is used for unpacking and verification of gzipped files downloaded from server. I wonder if it was related to problems we had recently (when gzip was disabled on server).

As for solution. Of course we can report this to Boinc but there are lot of old versions in the wild. Linux version is not compiled anymore. So I suggest following ugliest hack which should work:

diff --git a/wrapper.C b/wrapper.C index fe4db3e..7b1e56f 100644 --- a/wrapper.C +++ b/wrapper.C @@ -644,6 +644,16 @@ int main(int argc, char** argv) BOINC_OPTIONS options; int retval; +#ifndef _WIN32 + // Close good amount of possibly opened (inherited) handles except standard 0-2 + // (stdin, stdout, stderr) to avoid handle-inheritance-on-exec bug in Boinc. + for (int i = 3; i < 100; i++) + { + if (close(i) == 0) + std::cerr << "Handle " << i << " was forced closed!" << std::endl; + } +#endif + boinc_init_diagnostics( BOINC_DIAG_DUMPCALLSTACKENABLED | BOINC_DIAG_HEAPCHECKENABLED |


The error message which I've used for debugging should be removed. My version of Boinc always leaks at least two file handles (to time_stats.log and lockfile) so at least two messages will be printed and confuse users.

Considering swapping etc, it's still possible that wrapper #2 will execute before wrapper #1 has released alien handles. This case will be covered by repeated exec with delay, which is already implemented.

I don't know will this bug appear on Windows or not. The showstopper was linux kernel which refused to execute opened file. Windows kernel may have other rules. But this workaround will not work on Windows anyway (process will inherit HANDLE's, not "int handle"s).

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13835
ID: 53948
Credit: 375,113,310
RAC: 303,929
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,513,946)ESP LLR Turquoise: Earned 5,000,000 credits (7,150,009)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,847,031)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (13,659,368)SGS LLR Turquoise: Earned 5,000,000 credits (5,037,630)TRP LLR Turquoise: Earned 5,000,000 credits (6,308,522)Woodall LLR Turquoise: Earned 5,000,000 credits (6,390,624)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (94,307,251)WW Emerald: Earned 50,000,000 credits (88,532,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 87573 - Posted: 31 Aug 2015 | 18:46:30 UTC - in response to Message 87572.

Stream, if you're right, the true irony here is that the very change that fixed the problems with the Windows wrapper (switching from the wrapper copying LLR to BOINC copying LLR) is the source of the Linux problem.
____________
My lucky number is 75898524288+1

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 87580 - Posted: 1 Sep 2015 | 6:51:34 UTC - in response to Message 87573.
Last modified: 1 Sep 2015 | 6:52:08 UTC

Stream, if you're right, the true irony here is that the very change that fixed the problems with the Windows wrapper (switching from the wrapper copying LLR to BOINC copying LLR) is the source of the Linux problem.

Ask Jean to disable his questionable feature "cd to directory of LLR.EXE before everything else, even parsing of command line options, is done" which does not work on Windows anyway (the code is looking only for forward slashes). Or ask him do not touch this and adapt wrappers to current behavior - Linux wrapper must pass additional "-w slots_dir" option, Windows wrapper shall not - due to bug, LLR will stay in current (slots) dir like we want. Then you can run LLR right from projects directory, eliminating need for copying.

Profile DeleteNullProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 06
Posts: 263
ID: 2663
Credit: 12,570,804,117
RAC: 5,688,710
Discovered 69 mega primesEliminated 3 conjecture "k"sFound 4 primes in the 2018 Tour de PrimesFound 1 mega prime in the 2018 Tour de PrimesFound 4 primes in the 2019 Tour de PrimesFound 2 mega primes in the 2019 Tour de PrimesFound 1 prime in the 2019 Tour de Primes Mountain StageFound 2 primes in the 2020 Tour de PrimesFound 1 mega prime in the 2020 Tour de PrimesFound 4 primes in the 2021 Tour de PrimesFound 2 mega primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 2 mega primes in the 2022 Tour de Primes321 LLR Double Bronze: Earned 100,000,000 credits (100,400,495)Cullen LLR Emerald: Earned 50,000,000 credits (87,902,343)ESP LLR Emerald: Earned 50,000,000 credits (73,880,409)Generalized Cullen/Woodall LLR Emerald: Earned 50,000,000 credits (66,597,607)PPS LLR Double Gold: Earned 500,000,000 credits (500,580,171)PSP LLR Double Bronze: Earned 100,000,000 credits (100,970,333)SoB LLR Double Bronze: Earned 100,000,000 credits (102,624,508)SR5 LLR Double Bronze: Earned 100,000,000 credits (114,278,918)SGS LLR Emerald: Earned 50,000,000 credits (54,295,707)TPS LLR (retired) Bronze: Earned 10,000 credits (61,785)TRP LLR Double Bronze: Earned 100,000,000 credits (126,892,378)Woodall LLR Emerald: Earned 50,000,000 credits (83,238,690)321 Sieve (suspended) Emerald: Earned 50,000,000 credits (63,039,849)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,685,309)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (53,324,439)PPS Sieve Double Ruby: Earned 2,000,000,000 credits (4,097,488,173)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,057,785)TRP Sieve (suspended) Emerald: Earned 50,000,000 credits (50,146,560)AP 26/27 Double Gold: Earned 500,000,000 credits (504,799,060)GFN Double Ruby: Earned 2,000,000,000 credits (3,125,762,636)WW Double Ruby: Earned 2,000,000,000 credits (3,008,232,000)PSA Double Silver: Earned 200,000,000 credits (231,350,682)
Message 87589 - Posted: 1 Sep 2015 | 17:14:04 UTC

Provide sllr64.3.8.16.gz for linux hosts. This file has 6 MB instead of 36 MB for the sllr64.3.8.16 file (and is not a text file). This file can be copied by BOINC.
The wrapper just need a gunzip and can start the work.
____________
DeleteNull

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 87613 - Posted: 3 Sep 2015 | 9:04:23 UTC
Last modified: 3 Sep 2015 | 9:05:15 UTC

I reported this to the BOINC devs and the bug is now fixed ( https://github.com/BOINC/boinc/issues/1388/ ), although people will only pick up the fix when there is new release of the 7.6 / 7.7 clients. I will implement the workaround that stream suggested in the wrapper shortly.

- Iain
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 87615 - Posted: 3 Sep 2015 | 15:05:10 UTC

A new wrapper version (7.04) is now live on BOINC for Linux hosts only. This contains stream's workaround - please post here if you still observe any problems!

- Iain
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

Profile DeleteNullProject donor
Volunteer tester
Avatar
Send message
Joined: 6 Apr 06
Posts: 263
ID: 2663
Credit: 12,570,804,117
RAC: 5,688,710
Discovered 69 mega primesEliminated 3 conjecture "k"sFound 4 primes in the 2018 Tour de PrimesFound 1 mega prime in the 2018 Tour de PrimesFound 4 primes in the 2019 Tour de PrimesFound 2 mega primes in the 2019 Tour de PrimesFound 1 prime in the 2019 Tour de Primes Mountain StageFound 2 primes in the 2020 Tour de PrimesFound 1 mega prime in the 2020 Tour de PrimesFound 4 primes in the 2021 Tour de PrimesFound 2 mega primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 2 mega primes in the 2022 Tour de Primes321 LLR Double Bronze: Earned 100,000,000 credits (100,400,495)Cullen LLR Emerald: Earned 50,000,000 credits (87,902,343)ESP LLR Emerald: Earned 50,000,000 credits (73,880,409)Generalized Cullen/Woodall LLR Emerald: Earned 50,000,000 credits (66,597,607)PPS LLR Double Gold: Earned 500,000,000 credits (500,580,171)PSP LLR Double Bronze: Earned 100,000,000 credits (100,970,333)SoB LLR Double Bronze: Earned 100,000,000 credits (102,624,508)SR5 LLR Double Bronze: Earned 100,000,000 credits (114,278,918)SGS LLR Emerald: Earned 50,000,000 credits (54,295,707)TPS LLR (retired) Bronze: Earned 10,000 credits (61,785)TRP LLR Double Bronze: Earned 100,000,000 credits (126,892,378)Woodall LLR Emerald: Earned 50,000,000 credits (83,238,690)321 Sieve (suspended) Emerald: Earned 50,000,000 credits (63,039,849)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,685,309)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (53,324,439)PPS Sieve Double Ruby: Earned 2,000,000,000 credits (4,097,488,173)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,057,785)TRP Sieve (suspended) Emerald: Earned 50,000,000 credits (50,146,560)AP 26/27 Double Gold: Earned 500,000,000 credits (504,799,060)GFN Double Ruby: Earned 2,000,000,000 credits (3,125,762,636)WW Double Ruby: Earned 2,000,000,000 credits (3,008,232,000)PSA Double Silver: Earned 200,000,000 credits (231,350,682)
Message 87632 - Posted: 3 Sep 2015 | 19:05:03 UTC

I have read your first message today and have built BOINC with the fix for a linux box in a VM. After starting BOINC/PrimeGrid it gets the 7.04 version of the wrapper.

The good news: The message with "text file busy" disappears, even if 3 tasks were starting simultaniously.
But: No clue if the fix for the wrapper, or the fix for BOINC, or both are o.k.

;-) with the combination of both the upcoming challenge is o.k. for linux.

____________
DeleteNull

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 87635 - Posted: 3 Sep 2015 | 19:12:35 UTC - in response to Message 87615.

A new wrapper version (7.04) is now live on BOINC for Linux hosts only. This contains stream's workaround - please post here if you still observe any problems!

Right now I did only one usual test run on 8-cores system - and 8 tasks were run at same time without problems. Of course I'll made few more tests later but it seems to work. Thanks! Glad we did it before challenge.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13835
ID: 53948
Credit: 375,113,310
RAC: 303,929
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,513,946)ESP LLR Turquoise: Earned 5,000,000 credits (7,150,009)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,847,031)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (13,659,368)SGS LLR Turquoise: Earned 5,000,000 credits (5,037,630)TRP LLR Turquoise: Earned 5,000,000 credits (6,308,522)Woodall LLR Turquoise: Earned 5,000,000 credits (6,390,624)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (94,307,251)WW Emerald: Earned 50,000,000 credits (88,532,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 87639 - Posted: 3 Sep 2015 | 20:18:09 UTC - in response to Message 87635.

A new wrapper version (7.04) is now live on BOINC for Linux hosts only. This contains stream's workaround - please post here if you still observe any problems!

Right now I did only one usual test run on 8-cores system - and 8 tasks were run at same time without problems. Of course I'll made few more tests later but it seems to work. Thanks! Glad we did it before challenge.



And thank you for your help! It would not have been fixed without you. And by "it", I mean the BOINC client as well as our wrapper.
____________
My lucky number is 75898524288+1

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 88183 - Posted: 16 Sep 2015 | 19:48:33 UTC

Note that workaround does not work when different types of projects are mixed because all other wrappers are not fixed. Hit this bug again today trying to run 4 Cullen + 4 sieve. (This is poor AMD FX CPU which cannot run all 8 LLR applications, but quite happy with one LLR/floating-point and one integer/sieve application per core, with manual setup of CPU affinity). Unfixed sieve wrapper happily locked Cullen tasks. Good that I've noticed errors on console and hit Ctrl-S. Boinc itself was paused, and after 30 seconds all tasks, including bad ones, exited due to "no heartbeat from core". Hit Ctrl-Q, Boinc resumed execution and restarted all tasks, now without locked files. Just a bit of stress and few error messages on console, no Cullen work were lost.

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 88387 - Posted: 23 Sep 2015 | 7:08:37 UTC - in response to Message 88183.

Note that workaround does not work when different types of projects are mixed because all other wrappers are not fixed.


Good point, I will also fix the other wrappers (eventually).

- Iain
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 88460 - Posted: 25 Sep 2015 | 22:47:02 UTC

The show still goes on...

1. The trickle is sent only after 24 hours of continuous crunching. E.g. if you have a office PC which is run only working hours, you'll never have a trickle. Got 3 Cullens timed out this way. A possible fix is to save current timestamp to file if this file was not found (i.e. this is our first run).

2. Look like trickle timestamp file is opened in default/text mode ("r"/"w"), must be binary ("rb" / "wb") or it'll be lot of fun under Windows when timestamp happens to have 0x0A byte inside.

JimBProject donor
Honorary cruncher
Send message
Joined: 4 Aug 11
Posts: 917
ID: 107307
Credit: 977,945,376
RAC: 0
Discovered 1 mega prime321 LLR Ruby: Earned 2,000,000 credits (3,327,838)Cullen LLR Turquoise: Earned 5,000,000 credits (5,031,868)ESP LLR Turquoise: Earned 5,000,000 credits (5,064,082)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,038,750)PPS LLR Turquoise: Earned 5,000,000 credits (5,000,461)PSP LLR Turquoise: Earned 5,000,000 credits (7,674,374)SoB LLR Sapphire: Earned 20,000,000 credits (42,604,648)SR5 LLR Jade: Earned 10,000,000 credits (11,829,173)SGS LLR Ruby: Earned 2,000,000 credits (2,537,053)TRP LLR Ruby: Earned 2,000,000 credits (2,291,092)Woodall LLR Turquoise: Earned 5,000,000 credits (5,046,412)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,057,614)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,002,919)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,005,451)PPS Sieve Emerald: Earned 50,000,000 credits (52,042,965)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,341,676)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,070,804)AP 26/27 Jade: Earned 10,000,000 credits (10,742,251)GFN Emerald: Earned 50,000,000 credits (50,000,251)WW Ruby: Earned 2,000,000 credits (2,688,000)PSA Double Gold: Earned 500,000,000 credits (728,547,693)
Message 88461 - Posted: 25 Sep 2015 | 23:27:33 UTC - in response to Message 88460.
Last modified: 25 Sep 2015 | 23:31:45 UTC

2. Look like trickle timestamp file is opened in default/text mode ("r"/"w"), must be binary ("rb" / "wb") or it'll be lot of fun under Windows when timestamp happens to have 0x0A byte inside.

The timestamp comes through as an integer string - how is there going to be a \n in there?

Sample (real) trickle:
create_time: 1443221543 (note: this is the server time)
host_id: 498505
variety: llr_progress
handled: 0
xml:
<result_name>llr_sob_250288172_0</result_name>
<time>1443221541</time>
<trickle_up>
<progress>0.796269</progress>
<cputime>345236.480000</cputime>
<runtime>332559.500000</runtime>
</trickle_up>

Profile Rafael
Volunteer tester
Avatar
Send message
Joined: 22 Oct 14
Posts: 909
ID: 370496
Credit: 504,688,207
RAC: 202,950
321 LLR Jade: Earned 10,000,000 credits (10,008,611)Cullen LLR Jade: Earned 10,000,000 credits (10,005,009)ESP LLR Jade: Earned 10,000,000 credits (10,041,747)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,000,820)PPS LLR Jade: Earned 10,000,000 credits (10,094,995)PSP LLR Jade: Earned 10,000,000 credits (10,049,767)SoB LLR Sapphire: Earned 20,000,000 credits (33,279,792)SR5 LLR Jade: Earned 10,000,000 credits (10,003,746)SGS LLR Jade: Earned 10,000,000 credits (10,002,215)TRP LLR Jade: Earned 10,000,000 credits (10,011,903)Woodall LLR Jade: Earned 10,000,000 credits (10,076,850)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,033,828)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (10,037,204)PPS Sieve Jade: Earned 10,000,000 credits (10,305,147)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,000,053)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,030,160)AP 26/27 Emerald: Earned 50,000,000 credits (50,015,953)GFN Emerald: Earned 50,000,000 credits (65,216,408)WW Emerald: Earned 50,000,000 credits (50,712,000)PSA Double Bronze: Earned 100,000,000 credits (170,761,999)
Message 88462 - Posted: 26 Sep 2015 | 4:22:11 UTC - in response to Message 88460.

The show still goes on...

1. The trickle is sent only after 24 hours of continuous crunching. E.g. if you have a office PC which is run only working hours, you'll never have a trickle. Got 3 Cullens timed out this way. A possible fix is to save current timestamp to file if this file was not found (i.e. this is our first run).

2. Look like trickle timestamp file is opened in default/text mode ("r"/"w"), must be binary ("rb" / "wb") or it'll be lot of fun under Windows when timestamp happens to have 0x0A byte inside.

^This. RIP Cullen....

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 88603 - Posted: 1 Oct 2015 | 12:52:47 UTC - in response to Message 88462.

The show still goes on...

1. The trickle is sent only after 24 hours of continuous crunching. E.g. if you have a office PC which is run only working hours, you'll never have a trickle. Got 3 Cullens timed out this way. A possible fix is to save current timestamp to file if this file was not found (i.e. this is our first run).

2. Look like trickle timestamp file is opened in default/text mode ("r"/"w"), must be binary ("rb" / "wb") or it'll be lot of fun under Windows when timestamp happens to have 0x0A byte inside.

^This. RIP Cullen....


Sorry to take so long to follow this up. I now understand the bug in the logic which causes this. I will fix it and also the text/binary issue.

Cheers

- Iain

____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 88735 - Posted: 6 Oct 2015 | 7:40:49 UTC

I have posted new binaries (labelled 7.05beta) at https://github.com/ibethune/llr_wrapper/tree/master/bin which will trickle every 24 hours elapsed time without requiring first a period of 24 hours continuous crunching. I tested this out myself and it seems to work as designed. I also started writing the trickle file in binary mode to avoid the potential issue with line-ending bytes appearing in the file stream.

Please give these a go (after the challenge!!!) and let me know if you have success. I'd like to see successful runs on Windows and Linux before we go live with the new wrappers.

Cheers

- Iain
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 88741 - Posted: 6 Oct 2015 | 12:12:07 UTC - in response to Message 88735.

I have posted new binaries (labelled 7.05beta) at https://github.com/ibethune/llr_wrapper/tree/master/bin

It becomes fun. This one will not work too. No need to test, looking 5 secs at commit on github is enough to see that got_trickle flag is never set.

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 88783 - Posted: 7 Oct 2015 | 7:27:21 UTC - in response to Message 88741.

I have posted new binaries (labelled 7.05beta) at https://github.com/ibethune/llr_wrapper/tree/master/bin

It becomes fun. This one will not work too. No need to test, looking 5 secs at commit on github is enough to see that got_trickle flag is never set.


Thanks for the code review! I tested only that it did trickle after 24 hours of inactivity, not that it didn't trickle after <24 hours of inactivity...

New code and binaries now available on github (except Mac binaries, to come later).
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 88784 - Posted: 7 Oct 2015 | 7:47:33 UTC

Code looks good to me now, thanks.

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 88806 - Posted: 7 Oct 2015 | 18:58:00 UTC

And mac binaries are now available.

- Iain
____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

HonzaProject donor
Volunteer moderator
Volunteer tester
Project scientist
Send message
Joined: 15 Aug 05
Posts: 1936
ID: 352
Credit: 5,831,905,769
RAC: 1,045,540
Discovered 11 mega primesEliminated 4 conjecture "k"sFound 2 primes in the 2018 Tour de PrimesFound 1 prime in the 2018 Tour de Primes Mountain Stage2019 Tour de Primes largest primeFound 4 primes in the 2019 Tour de PrimesFound 1 mega prime in the 2019 Tour de PrimesFound 1 prime in the 2019 Tour de Primes Mountain StageFound 1 prime in the 2020 Tour de PrimesFound 4 primes in the 2021 Tour de PrimesFound 1 mega prime in the 2021 Tour de PrimesFound 1 prime in the 2021 Tour de Primes Mountain StageFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de Primes321 LLR Double Bronze: Earned 100,000,000 credits (105,242,843)Cullen LLR Double Bronze: Earned 100,000,000 credits (118,233,898)ESP LLR Double Bronze: Earned 100,000,000 credits (100,642,296)Generalized Cullen/Woodall LLR Double Bronze: Earned 100,000,000 credits (106,956,296)PPS LLR Double Silver: Earned 200,000,000 credits (244,875,590)PSP LLR Double Bronze: Earned 100,000,000 credits (101,484,952)SoB LLR Double Bronze: Earned 100,000,000 credits (113,220,736)SR5 LLR Double Silver: Earned 200,000,000 credits (201,117,461)SGS LLR Double Bronze: Earned 100,000,000 credits (100,409,432)TPS LLR (retired) Bronze: Earned 10,000 credits (43,033)TRP LLR Double Bronze: Earned 100,000,000 credits (131,874,357)Woodall LLR Double Bronze: Earned 100,000,000 credits (101,172,892)321 Sieve (suspended) Double Bronze: Earned 100,000,000 credits (115,948,450)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,142,109)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (50,504,945)PPS Sieve Double Gold: Earned 500,000,000 credits (513,057,580)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,288,222)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,149,354)AP 26/27 Double Silver: Earned 200,000,000 credits (240,277,097)GFN Double Gold: Earned 500,000,000 credits (888,222,621)WW Double Ruby: Earned 2,000,000,000 credits (2,018,796,000)PSA Double Gold: Earned 500,000,000 credits (535,232,795)
Message 88825 - Posted: 8 Oct 2015 | 8:28:40 UTC

Hostid=500165, Win 7 x86.
I intend to finish those 4 CUL tasks.

07/10/2015 16:07:12 | PrimeGrid | Sending scheduler request: To send trickle-up message.
07/10/2015 16:07:15 | PrimeGrid | Scheduler request completed

____________
My stats
Badge score: 1*1 + 5*1 + 8*3 + 9*11 + 10*1 + 11*1 + 12*3 = 186

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 89344 - Posted: 26 Oct 2015 | 5:48:13 UTC

I think I've found another logic problem.

If a task was started less then 23 hours before deadline, crunched well but was not fast enough and missed the deadline, trickle will be not sent (24 hours wasn't passed yet) and task will expire on server. Another scenario is that task was started but later computer was turned off for a night. Non-working computer cannot send a trickle, and task will expire too.

The fix in code will simple one-liner: initial trickle timestamp must be not a current time, but "time(NULL) - 24hours + 30 seconds)". This will force first trickle to be sent immediately after task was started (within 30 seconds, which is arbitrary value and can be changed), so server will know. But it mean that every PG task will also send a trickle, increasing user's traffic and load on server. So I'm leaving this for discussion.

Profile Rafael
Volunteer tester
Avatar
Send message
Joined: 22 Oct 14
Posts: 909
ID: 370496
Credit: 504,688,207
RAC: 202,950
321 LLR Jade: Earned 10,000,000 credits (10,008,611)Cullen LLR Jade: Earned 10,000,000 credits (10,005,009)ESP LLR Jade: Earned 10,000,000 credits (10,041,747)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,000,820)PPS LLR Jade: Earned 10,000,000 credits (10,094,995)PSP LLR Jade: Earned 10,000,000 credits (10,049,767)SoB LLR Sapphire: Earned 20,000,000 credits (33,279,792)SR5 LLR Jade: Earned 10,000,000 credits (10,003,746)SGS LLR Jade: Earned 10,000,000 credits (10,002,215)TRP LLR Jade: Earned 10,000,000 credits (10,011,903)Woodall LLR Jade: Earned 10,000,000 credits (10,076,850)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,033,828)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (10,037,204)PPS Sieve Jade: Earned 10,000,000 credits (10,305,147)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,000,053)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,030,160)AP 26/27 Emerald: Earned 50,000,000 credits (50,015,953)GFN Emerald: Earned 50,000,000 credits (65,216,408)WW Emerald: Earned 50,000,000 credits (50,712,000)PSA Double Bronze: Earned 100,000,000 credits (170,761,999)
Message 89346 - Posted: 26 Oct 2015 | 8:06:47 UTC - in response to Message 89344.

I think I've found another logic problem.

If a task was started less then 23 hours before deadline, crunched well but was not fast enough and missed the deadline, trickle will be not sent (24 hours wasn't passed yet) and task will expire on server. Another scenario is that task was started but later computer was turned off for a night. Non-working computer cannot send a trickle, and task will expire too.

The fix in code will simple one-liner: initial trickle timestamp must be not a current time, but "time(NULL) - 24hours + 30 seconds)". This will force first trickle to be sent immediately after task was started (within 30 seconds, which is arbitrary value and can be changed), so server will know. But it mean that every PG task will also send a trickle, increasing user's traffic and load on server. So I'm leaving this for discussion.

1h initial delay seems like a good start. Should avoid the multitude of small tasks (such as SGS or PPSE) from overloading the server, while still being fairly early in crunching.

HonzaProject donor
Volunteer moderator
Volunteer tester
Project scientist
Send message
Joined: 15 Aug 05
Posts: 1936
ID: 352
Credit: 5,831,905,769
RAC: 1,045,540
Discovered 11 mega primesEliminated 4 conjecture "k"sFound 2 primes in the 2018 Tour de PrimesFound 1 prime in the 2018 Tour de Primes Mountain Stage2019 Tour de Primes largest primeFound 4 primes in the 2019 Tour de PrimesFound 1 mega prime in the 2019 Tour de PrimesFound 1 prime in the 2019 Tour de Primes Mountain StageFound 1 prime in the 2020 Tour de PrimesFound 4 primes in the 2021 Tour de PrimesFound 1 mega prime in the 2021 Tour de PrimesFound 1 prime in the 2021 Tour de Primes Mountain StageFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de Primes321 LLR Double Bronze: Earned 100,000,000 credits (105,242,843)Cullen LLR Double Bronze: Earned 100,000,000 credits (118,233,898)ESP LLR Double Bronze: Earned 100,000,000 credits (100,642,296)Generalized Cullen/Woodall LLR Double Bronze: Earned 100,000,000 credits (106,956,296)PPS LLR Double Silver: Earned 200,000,000 credits (244,875,590)PSP LLR Double Bronze: Earned 100,000,000 credits (101,484,952)SoB LLR Double Bronze: Earned 100,000,000 credits (113,220,736)SR5 LLR Double Silver: Earned 200,000,000 credits (201,117,461)SGS LLR Double Bronze: Earned 100,000,000 credits (100,409,432)TPS LLR (retired) Bronze: Earned 10,000 credits (43,033)TRP LLR Double Bronze: Earned 100,000,000 credits (131,874,357)Woodall LLR Double Bronze: Earned 100,000,000 credits (101,172,892)321 Sieve (suspended) Double Bronze: Earned 100,000,000 credits (115,948,450)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,142,109)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (50,504,945)PPS Sieve Double Gold: Earned 500,000,000 credits (513,057,580)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,288,222)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,149,354)AP 26/27 Double Silver: Earned 200,000,000 credits (240,277,097)GFN Double Gold: Earned 500,000,000 credits (888,222,621)WW Double Ruby: Earned 2,000,000,000 credits (2,018,796,000)PSA Double Gold: Earned 500,000,000 credits (535,232,795)
Message 89347 - Posted: 26 Oct 2015 | 8:34:54 UTC

If implemented, I'm also inclined toward initial delay for short tasks.

What is short task?
SGS and PPSE?
Or those with 4 days deadline?

If there any other use of initial trickle timestamp?
Would it help us to better understand scheduller/deadline issues and it's scope?
____________
My stats
Badge score: 1*1 + 5*1 + 8*3 + 9*11 + 10*1 + 11*1 + 12*3 = 186

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13835
ID: 53948
Credit: 375,113,310
RAC: 303,929
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,513,946)ESP LLR Turquoise: Earned 5,000,000 credits (7,150,009)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,847,031)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (13,659,368)SGS LLR Turquoise: Earned 5,000,000 credits (5,037,630)TRP LLR Turquoise: Earned 5,000,000 credits (6,308,522)Woodall LLR Turquoise: Earned 5,000,000 credits (6,390,624)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (94,307,251)WW Emerald: Earned 50,000,000 credits (88,532,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 89348 - Posted: 26 Oct 2015 | 9:54:21 UTC - in response to Message 89344.

If a task was started less then 23 hours before deadline, crunched well but was not fast enough and missed the deadline, trickle will be not sent (24 hours wasn't passed yet) and task will expire on server. Another scenario is that task was started but later computer was turned off for a night. Non-working computer cannot send a trickle, and task will expire too.


We accounted for this is the initial design. The server's record of the deadline is initially 25 hours later than the client's record of the deadline -- so a task that starts immediately before the deadline expires (as the client knows it) and then runs for 24 hours still can send the trickle up to the server before the server thinks the deadline has expired.
____________
My lucky number is 75898524288+1

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 89349 - Posted: 26 Oct 2015 | 10:29:01 UTC - in response to Message 89348.

If a task was started less then 23 hours before deadline, crunched well but was not fast enough and missed the deadline, trickle will be not sent (24 hours wasn't passed yet) and task will expire on server. Another scenario is that task was started but later computer was turned off for a night. Non-working computer cannot send a trickle, and task will expire too.

We accounted for this is the initial design. The server's record of the deadline is initially 25 hours later than the client's record of the deadline -- so a task that starts immediately before the deadline expires (as the client knows it) and then runs for 24 hours still can send the trickle up to the server before the server thinks the deadline has expired.

Thanks, it look good to me. This question is resolved.

The only question left is when we'll use 7.05 binaries which Iain uploaded almost three weeks ago. Currently used implementation is almost useless. I've reviewed his code and accepted the fix. The challenge is over.

Iain BethuneProject donor
Honorary cruncher
Send message
Joined: 28 Jan 09
Posts: 1588
ID: 34775
Credit: 194,056,043
RAC: 0
321 LLR Gold: Earned 500,000 credits (597,175)Cullen LLR Amethyst: Earned 1,000,000 credits (1,355,381)ESP LLR Turquoise: Earned 5,000,000 credits (5,048,594)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,564,412)PPS LLR Amethyst: Earned 1,000,000 credits (1,025,115)PSP LLR Sapphire: Earned 20,000,000 credits (28,367,849)SoB LLR Jade: Earned 10,000,000 credits (16,215,329)SR5 LLR Turquoise: Earned 5,000,000 credits (5,189,992)SGS LLR Amethyst: Earned 1,000,000 credits (1,244,067)TRP LLR Turquoise: Earned 5,000,000 credits (5,169,405)Woodall LLR Amethyst: Earned 1,000,000 credits (1,070,956)321 Sieve (suspended) Bronze: Earned 10,000 credits (20,003)Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (200,371)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,645,025)PPS Sieve Turquoise: Earned 5,000,000 credits (7,536,532)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,017,144)TRP Sieve (suspended) Gold: Earned 500,000 credits (554,946)AP 26/27 Ruby: Earned 2,000,000 credits (3,577,848)GFN Emerald: Earned 50,000,000 credits (97,047,976)PSA Ruby: Earned 2,000,000 credits (4,606,694)
Message 89507 - Posted: 2 Nov 2015 | 20:02:29 UTC - in response to Message 89349.

The only question left is when we'll use 7.05 binaries which Iain uploaded almost three weeks ago.


Subject to a few internal sanity checks, within the next few days hopefully!

- Iain

____________
Twitter: IainBethune
Proud member of team "Aggie The Pew". Go Aggie!
3073428256125*2^1290000-1 is Prime!

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13835
ID: 53948
Credit: 375,113,310
RAC: 303,929
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,513,946)ESP LLR Turquoise: Earned 5,000,000 credits (7,150,009)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,847,031)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (13,659,368)SGS LLR Turquoise: Earned 5,000,000 credits (5,037,630)TRP LLR Turquoise: Earned 5,000,000 credits (6,308,522)Woodall LLR Turquoise: Earned 5,000,000 credits (6,390,624)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (94,307,251)WW Emerald: Earned 50,000,000 credits (88,532,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 89574 - Posted: 5 Nov 2015 | 2:28:03 UTC

The new wrapper is now live on all LLR projects. The new BOINC app version number is 7.05.

Let us know if there's any problems.
____________
My lucky number is 75898524288+1

rjs5
Send message
Joined: 20 Feb 11
Posts: 35
ID: 87238
Credit: 826,190,141
RAC: 4,958
Discovered 3 mega primes321 LLR Jade: Earned 10,000,000 credits (12,471,787)Cullen LLR Jade: Earned 10,000,000 credits (10,235,118)ESP LLR Jade: Earned 10,000,000 credits (10,191,519)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,253,932)PPS LLR Jade: Earned 10,000,000 credits (10,025,040)PSP LLR Jade: Earned 10,000,000 credits (10,188,140)SoB LLR Jade: Earned 10,000,000 credits (10,297,183)SR5 LLR Jade: Earned 10,000,000 credits (10,048,145)SGS LLR Jade: Earned 10,000,000 credits (10,012,220)TRP LLR Jade: Earned 10,000,000 credits (10,179,749)Woodall LLR Jade: Earned 10,000,000 credits (10,178,319)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,090,924)Cullen/Woodall Sieve (suspended) Gold: Earned 500,000 credits (879,677)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,273,914)PPS Sieve Emerald: Earned 50,000,000 credits (60,310,763)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,437,484)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,509,929)AP 26/27 Emerald: Earned 50,000,000 credits (50,383,866)GFN Double Gold: Earned 500,000,000 credits (516,572,482)WW Sapphire: Earned 20,000,000 credits (22,116,000)PSA Sapphire: Earned 20,000,000 credits (35,533,950)
Message 89667 - Posted: 11 Nov 2015 | 14:45:33 UTC - in response to Message 89574.

The new wrapper is now live on all LLR projects. The new BOINC app version number is 7.05.

Let us know if there's any problems.


I am seeing the "text busy" problems with 7.05 and Boinc 7.2.42 on Fedora 22 Linux.


I am seeing the "text busy" problem on two Linux machines. They are both running the standard distribution version of BOINC which is currently at 7.2.42. When I ran only SGS on the D-1540 Xeon Broadwell CPU before, it seemed to behave strange running SGS tasks but they would complete .... taking about 50% longer than I would expect.

I have 1 workaround which is "don't do that". I guess I could run a newer BOINC custom install?

Computer ID 499201
CPU type GenuineIntel
Intel(R) Xeon(R) CPU D-1540 @ 2.00GHz [Family 6 Model 86 Stepping 2]
Number of processors 16
Coprocessors ---
Operating System Linux
4.2.5-201.fc22.x86_64
BOINC version 7.2.42
Memory 32072.87 MB

and

Computer ID 489114
CPU type GenuineIntel
Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz [Family 6 Model 60 Stepping 3]
Number of processors 8
Coprocessors NVIDIA GeForce GTX 650 Ti (2047MB)
Operating System Linux
4.1.10-100.fc21.x86_64
BOINC version 7.2.42
Memory 24063.57 MB



Computer ID 499201 is configured to run only SGS. I just enabled NEW TASKS after Primegrid jobs had been drained for awhile. It seemed to "restart" the tasks on an earlier app. Now it just seems to get the TEXT BUSY and abort.



Computer ID 489114 has been running Primegrid jobs over time but I checked and it also aborted SGS jobs.






stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 89675 - Posted: 11 Nov 2015 | 20:35:01 UTC - in response to Message 89667.


I am seeing the "text busy" problems with 7.05 and Boinc 7.2.42 on Fedora 22 Linux.

Computer ID 499201

I see it's also running Genefer tasks.


Computer ID 489114

I see tasks from all kinds of projects, including TRP Sieve.

Don't mix projects. Other wrappers does not have this workaround included (yet). If you'll try to run LLR (SGS) + Genefer or SGS + Sieve, bug will appear again because Boinc will lock file via second wrapper.

The only other solution is to rebuild Boinc from latest source code.

rjs5
Send message
Joined: 20 Feb 11
Posts: 35
ID: 87238
Credit: 826,190,141
RAC: 4,958
Discovered 3 mega primes321 LLR Jade: Earned 10,000,000 credits (12,471,787)Cullen LLR Jade: Earned 10,000,000 credits (10,235,118)ESP LLR Jade: Earned 10,000,000 credits (10,191,519)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,253,932)PPS LLR Jade: Earned 10,000,000 credits (10,025,040)PSP LLR Jade: Earned 10,000,000 credits (10,188,140)SoB LLR Jade: Earned 10,000,000 credits (10,297,183)SR5 LLR Jade: Earned 10,000,000 credits (10,048,145)SGS LLR Jade: Earned 10,000,000 credits (10,012,220)TRP LLR Jade: Earned 10,000,000 credits (10,179,749)Woodall LLR Jade: Earned 10,000,000 credits (10,178,319)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,090,924)Cullen/Woodall Sieve (suspended) Gold: Earned 500,000 credits (879,677)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,273,914)PPS Sieve Emerald: Earned 50,000,000 credits (60,310,763)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,437,484)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,509,929)AP 26/27 Emerald: Earned 50,000,000 credits (50,383,866)GFN Double Gold: Earned 500,000,000 credits (516,572,482)WW Sapphire: Earned 20,000,000 credits (22,116,000)PSA Sapphire: Earned 20,000,000 credits (35,533,950)
Message 89678 - Posted: 11 Nov 2015 | 22:45:18 UTC - in response to Message 89675.


I am seeing the "text busy" problems with 7.05 and Boinc 7.2.42 on Fedora 22 Linux.

Computer ID 499201

I see it's also running Genefer tasks.


Computer ID 489114

I see tasks from all kinds of projects, including TRP Sieve.

Don't mix projects. Other wrappers does not have this workaround included (yet). If you'll try to run LLR (SGS) + Genefer or SGS + Sieve, bug will appear again because Boinc will lock file via second wrapper.

The only other solution is to rebuild Boinc from latest source code.



Hmmmm. Thanks.

This is the first time I have ran the CPU version of Genefer, so that is likely the catalyst problem.

Until Linux Boinc version reaches some "modern version" level (ie a lot newer than 7.2.42), sort of .... run only
1. LLR CPU tasks or
2. Genefer CPU tasks or
3. Sieve CPU tasks

... and don't mix task types ... and things will heal .... but I might see some repeat instances of the error if I forget and mix jobs.

stream
Volunteer moderator
Project administrator
Volunteer developer
Volunteer tester
Send message
Joined: 1 Mar 14
Posts: 1004
ID: 301928
Credit: 543,187,198
RAC: 5
Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 1 prime in the 2021 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,011,570)Cullen LLR Jade: Earned 10,000,000 credits (10,009,374)ESP LLR Jade: Earned 10,000,000 credits (10,009,221)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,012,217)PPS LLR Jade: Earned 10,000,000 credits (16,321,552)PSP LLR Jade: Earned 10,000,000 credits (10,044,081)SoB LLR Jade: Earned 10,000,000 credits (10,064,750)SR5 LLR Jade: Earned 10,000,000 credits (10,002,051)SGS LLR Jade: Earned 10,000,000 credits (10,001,295)TRP LLR Jade: Earned 10,000,000 credits (10,002,411)Woodall LLR Jade: Earned 10,000,000 credits (10,013,921)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,004,228)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,047,667)PPS Sieve Sapphire: Earned 20,000,000 credits (20,866,490)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,043,271)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,015,177)AP 26/27 Sapphire: Earned 20,000,000 credits (20,045,194)GFN Emerald: Earned 50,000,000 credits (55,355,287)WW Emerald: Earned 50,000,000 credits (50,016,000)PSA Double Silver: Earned 200,000,000 credits (200,301,443)
Message 89688 - Posted: 12 Nov 2015 | 7:15:14 UTC - in response to Message 89678.

Until Linux Boinc version reaches some "modern version" level (ie a lot newer than 7.2.42), sort of

I'm not sure it'll ever happen. Version 7.2.42 was released long time ago, it seems that they've just stopped making linux binaries. So either recent version will eventually became available in your Linux distribution compiled by OS developers or as Launchpad/PPA or similar side project, either you have to checkout Boinc source code from github and compile it yourself.


.... run only
1. LLR CPU tasks or
2. Genefer CPU tasks or
3. Sieve CPU tasks

Don't mix LLR and anything else, Generer and Sieve are not affected and can be mixed (problem is triggered by big LLR executable, see in this topic above).

The bug usually appears after reboot or when you're reloading empty system with tasks. If your boinc is running in console window (not as daemon), you'll see "task xxxx unexpectedly finished" or similar error message. One trick exist in this case: press Ctrl-S on this console to suspend Boinc process, then wait for 60 seconds. During this period, all running tasks will exit due to "No heartbeat from Boinc core" and release locked files. Then press Ctrl-Q to resume Boinc. Boinc will restart all tasks from checkpoint and things will go smooth from now on until next reboot or big reload.

mackerelProject donor
Volunteer tester
Avatar
Send message
Joined: 2 Oct 08
Posts: 2602
ID: 29980
Credit: 564,266,805
RAC: 37,713
Discovered 6 mega primesEliminated 1 conjecture "k"Found 3 primes in the 2018 Tour de PrimesFound 1 mega prime in the 2018 Tour de PrimesFound 5 primes in the 2019 Tour de PrimesFound 6 primes in the 2020 Tour de PrimesFound 5 primes in the 2021 Tour de PrimesFound 1 prime in the 2022 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,736,922)Cullen LLR Turquoise: Earned 5,000,000 credits (6,154,591)ESP LLR Turquoise: Earned 5,000,000 credits (7,207,880)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (6,714,227)PPS LLR Double Bronze: Earned 100,000,000 credits (119,960,737)PSP LLR Jade: Earned 10,000,000 credits (16,676,406)SoB LLR Sapphire: Earned 20,000,000 credits (20,019,367)SR5 LLR Sapphire: Earned 20,000,000 credits (26,030,253)SGS LLR Turquoise: Earned 5,000,000 credits (7,361,220)TPS LLR (retired) Bronze: Earned 10,000 credits (34,130)TRP LLR Sapphire: Earned 20,000,000 credits (38,431,288)Woodall LLR Turquoise: Earned 5,000,000 credits (8,968,201)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,236,219)Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,383,853)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,626,419)PPS Sieve Emerald: Earned 50,000,000 credits (76,969,144)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,293,882)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,012,757)AP 26/27 Sapphire: Earned 20,000,000 credits (27,813,588)GFN Emerald: Earned 50,000,000 credits (91,392,023)WW Sapphire: Earned 20,000,000 credits (43,304,000)PSA Ruby: Earned 2,000,000 credits (2,939,755)
Message 89691 - Posted: 12 Nov 2015 | 8:56:08 UTC

If it might be of any help, the boinc package from Ubuntu reports itself as version 7.6.6.

Message boards : Number crunching : New LLR wrapper testing

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2022 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 0.97, 1.21, 1.18
Generated 8 Dec 2022 | 6:27:43 UTC