PrimeGrid
Please visit donation page to help the project cover running costs for this month

Advanced search

Message boards : Number crunching : Giving out too much work

Author Message
Peter Hucker
Send message
Joined: 23 Sep 06
Posts: 115
ID: 3541
Credit: 46,730,776
RAC: 67,767
321 LLR Silver: Earned 100,000 credits (117,162)Cullen LLR Silver: Earned 100,000 credits (199,800)ESP LLR Bronze: Earned 10,000 credits (99,691)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (100,048)PPS LLR Bronze: Earned 10,000 credits (29,800)PSP LLR Silver: Earned 100,000 credits (296,161)SoB LLR Amethyst: Earned 1,000,000 credits (1,376,215)SR5 LLR Bronze: Earned 10,000 credits (39,698)SGS LLR Bronze: Earned 10,000 credits (18,533)TRP LLR Bronze: Earned 10,000 credits (62,235)Woodall LLR Silver: Earned 100,000 credits (240,222)321 Sieve (suspended) Bronze: Earned 10,000 credits (30,838)PPS Sieve Ruby: Earned 2,000,000 credits (2,509,768)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,965)TRP Sieve (suspended) Bronze: Earned 10,000 credits (14,492)AP 26/27 Ruby: Earned 2,000,000 credits (4,432,423)WW Silver: Earned 100,000 credits (484,000)GFN Sapphire: Earned 20,000,000 credits (36,621,124)
Message 146030 - Posted: 3 Dec 2020 | 10:32:05 UTC

These 6 computers have been on Primegrid for a month now, so my computers know how long tasks take, and the times are shown correctly. But even doing short tasks (say genefer 15 on a GPU) which take 3 minutes each, with a 3 hour buffer I'm given 8 hours of tasks. Why? This really screws things up with a longer buffer, because too much is downloaded and other projects fail to meet their shorter deadlines. For example, I set the buffer to 3 days, prime gives me 8 days, there's too much work, panic mode is engaged, and we all know panic mode in boinc doesn't work properly, it leaves things to the last minute and when it has 24 core prime and many 1 core WCG tasks to do, it can't work out how to fit everything in sensibly. WCG tasks are getting returned late. Please fix the server to give out the amount of work I request, not 3 times as much!

Profile JeppeSNProject donor
Avatar
Send message
Joined: 5 Apr 14
Posts: 1506
ID: 306875
Credit: 34,193,310
RAC: 9,241
Found 1 prime in the 2020 Tour de Primes321 LLR Gold: Earned 500,000 credits (529,293)Cullen LLR Gold: Earned 500,000 credits (611,298)ESP LLR Silver: Earned 100,000 credits (174,818)Generalized Cullen/Woodall LLR Bronze: Earned 10,000 credits (35,236)PPS LLR Jade: Earned 10,000,000 credits (12,295,635)PSP LLR Silver: Earned 100,000 credits (212,242)SoB LLR Silver: Earned 100,000 credits (466,812)SR5 LLR Silver: Earned 100,000 credits (145,419)SGS LLR Silver: Earned 100,000 credits (112,277)TRP LLR Silver: Earned 100,000 credits (342,501)Woodall LLR Silver: Earned 100,000 credits (109,455)321 Sieve (suspended) Silver: Earned 100,000 credits (175,037)PPS Sieve Bronze: Earned 10,000 credits (10,113)AP 26/27 Bronze: Earned 10,000 credits (12,129)WW Turquoise: Earned 5,000,000 credits (9,640,000)GFN Amethyst: Earned 1,000,000 credits (1,707,013)PSA Turquoise: Earned 5,000,000 credits (7,614,290)
Message 146032 - Posted: 3 Dec 2020 | 10:57:39 UTC

BOINC can be quite unpredictable.

Have you considered having zero buffer, for projects (including Genefer) where there is a "race" and you will be declared finder of a prime only if you win that race (return your task 1st)? This does require that your computers have permanent connection to the internet.

/JeppeSN

Profile dannyridel
Volunteer tester
Avatar
Send message
Joined: 3 Feb 19
Posts: 886
ID: 1097922
Credit: 12,141,664
RAC: 49,255
321 LLR Silver: Earned 100,000 credits (227,504)Cullen LLR Silver: Earned 100,000 credits (112,212)ESP LLR Silver: Earned 100,000 credits (255,803)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (251,193)PPS LLR Amethyst: Earned 1,000,000 credits (1,982,797)PSP LLR Silver: Earned 100,000 credits (100,559)SoB LLR Gold: Earned 500,000 credits (533,625)SR5 LLR Silver: Earned 100,000 credits (103,183)SGS LLR Silver: Earned 100,000 credits (107,487)TRP LLR Silver: Earned 100,000 credits (109,075)Woodall LLR Silver: Earned 100,000 credits (117,864)321 Sieve (suspended) Gold: Earned 500,000 credits (506,814)Generalized Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (30,033)PPS Sieve Ruby: Earned 2,000,000 credits (2,808,043)AP 26/27 Gold: Earned 500,000 credits (986,492)WW Amethyst: Earned 1,000,000 credits (1,336,000)GFN Ruby: Earned 2,000,000 credits (2,199,944)PSA Silver: Earned 100,000 credits (373,034)
Message 146043 - Posted: 3 Dec 2020 | 13:25:38 UTC
Last modified: 3 Dec 2020 | 13:28:58 UTC

I agree with Jeppe's solution:
for non-LLR2 projects (WW, AP, all GFNs, PPSE, SGS), it is highly recommended that you DO NOT have a bunker of more than 0.

These tasks are sent out in magnitudes of two, and in the case of a prime, the user who crunched the first returned task will be primary finder and the second user double checker. If two users have the same computing force, and one user has a bunker, then the user who doesn't will process that task immediately while the one with a bunker will most probably process some other tasks before getting to this prime one. And therefore resulting in being double checker.
No one wants to be DCer, right?
____________
SHSIDElectronicsGroup@outlook.com

waiting for a TdP prime...
Proth "SoB": 44243*2^440969+1


Profile mikey
Avatar
Send message
Joined: 17 Mar 09
Posts: 1275
ID: 37043
Credit: 529,533,435
RAC: 198,908
Discovered 1 mega prime321 LLR Ruby: Earned 2,000,000 credits (2,038,739)Cullen LLR Ruby: Earned 2,000,000 credits (2,074,615)ESP LLR Ruby: Earned 2,000,000 credits (2,243,517)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,142,353)PPS LLR Turquoise: Earned 5,000,000 credits (7,292,459)PSP LLR Ruby: Earned 2,000,000 credits (2,232,103)SoB LLR Ruby: Earned 2,000,000 credits (2,934,612)SR5 LLR Ruby: Earned 2,000,000 credits (2,053,250)SGS LLR Turquoise: Earned 5,000,000 credits (5,152,318)TRP LLR Ruby: Earned 2,000,000 credits (2,405,015)Woodall LLR Ruby: Earned 2,000,000 credits (2,014,811)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (23,770,672)Cullen/Woodall Sieve (suspended) Gold: Earned 500,000 credits (944,431)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,813,253)PPS Sieve Double Silver: Earned 200,000,000 credits (342,011,628)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,446,797)AP 26/27 Sapphire: Earned 20,000,000 credits (33,140,471)WW Ruby: Earned 2,000,000 credits (4,084,000)GFN Sapphire: Earned 20,000,000 credits (49,299,387)PSA Sapphire: Earned 20,000,000 credits (20,457,430)
Message 146062 - Posted: 3 Dec 2020 | 17:40:55 UTC - in response to Message 146043.

No one wants to be DCer, right?


Weeeeellllllll maybe...in todays World of someone always being able to get faster and better hardware being the DC'er is much better than being nothing at all. Nothing at all being those that aborted the task or for some reason the task errored out and had to be resent to someone else. NO I'm not denigrating those that the task times out on or choose to abort the task for whatever reason or those that for some reason the tasks fails to complete correctly...they are a fact of crunching.

Profile gemini8Project donor
Send message
Joined: 2 Jan 16
Posts: 98
ID: 434794
Credit: 191,654,205
RAC: 110,304
Found 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Amethyst: Earned 1,000,000 credits (1,029,579)Cullen LLR Amethyst: Earned 1,000,000 credits (1,970,265)ESP LLR Ruby: Earned 2,000,000 credits (2,022,721)Generalized Cullen/Woodall LLR Gold: Earned 500,000 credits (661,578)PPS LLR Jade: Earned 10,000,000 credits (14,526,572)PSP LLR Ruby: Earned 2,000,000 credits (2,255,024)SoB LLR Turquoise: Earned 5,000,000 credits (9,221,370)SR5 LLR Gold: Earned 500,000 credits (500,512)SGS LLR Amethyst: Earned 1,000,000 credits (1,065,013)TRP LLR Ruby: Earned 2,000,000 credits (2,162,752)Woodall LLR Ruby: Earned 2,000,000 credits (2,000,471)321 Sieve (suspended) Ruby: Earned 2,000,000 credits (2,035,186)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,002,647)PPS Sieve Sapphire: Earned 20,000,000 credits (46,148,990)TRP Sieve (suspended) Silver: Earned 100,000 credits (156,305)AP 26/27 Ruby: Earned 2,000,000 credits (3,873,194)WW Amethyst: Earned 1,000,000 credits (1,000,000)GFN Emerald: Earned 50,000,000 credits (96,021,872)
Message 146145 - Posted: 5 Dec 2020 | 13:12:09 UTC

I think I read somewhere that the problem is within the Boinc software, not the server.
So it might be useful to try other versions of Boinc.
____________
Greetings, Jens

92914140^65536+1

Peter Hucker
Send message
Joined: 23 Sep 06
Posts: 115
ID: 3541
Credit: 46,730,776
RAC: 67,767
321 LLR Silver: Earned 100,000 credits (117,162)Cullen LLR Silver: Earned 100,000 credits (199,800)ESP LLR Bronze: Earned 10,000 credits (99,691)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (100,048)PPS LLR Bronze: Earned 10,000 credits (29,800)PSP LLR Silver: Earned 100,000 credits (296,161)SoB LLR Amethyst: Earned 1,000,000 credits (1,376,215)SR5 LLR Bronze: Earned 10,000 credits (39,698)SGS LLR Bronze: Earned 10,000 credits (18,533)TRP LLR Bronze: Earned 10,000 credits (62,235)Woodall LLR Silver: Earned 100,000 credits (240,222)321 Sieve (suspended) Bronze: Earned 10,000 credits (30,838)PPS Sieve Ruby: Earned 2,000,000 credits (2,509,768)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,965)TRP Sieve (suspended) Bronze: Earned 10,000 credits (14,492)AP 26/27 Ruby: Earned 2,000,000 credits (4,432,423)WW Silver: Earned 100,000 credits (484,000)GFN Sapphire: Earned 20,000,000 credits (36,621,124)
Message 146147 - Posted: 5 Dec 2020 | 14:19:16 UTC - in response to Message 146145.
Last modified: 5 Dec 2020 | 14:20:38 UTC

I think I read somewhere that the problem is within the Boinc software, not the server.
So it might be useful to try other versions of Boinc.


It seems to be a problem with the number of cores. Something is sending me 24 times as much work as I request, if I have 24 cores. Something somewhere has mixed up "time taken per core" and "time taken per CPU". I've done a test, which can be seen in this discussion on the Boinc Forums, it's being looked into by Richard Haselgrove:

https://boinc.berkeley.edu/dev/forum_thread.php?id=14068&postid=101969#101969

GDB
Send message
Joined: 15 Nov 11
Posts: 254
ID: 119185
Credit: 2,823,766,161
RAC: 609,088
Discovered 2 mega primes321 LLR Jade: Earned 10,000,000 credits (12,924,181)Cullen LLR Turquoise: Earned 5,000,000 credits (5,837,403)ESP LLR Turquoise: Earned 5,000,000 credits (5,600,055)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,474,599)PPS LLR Jade: Earned 10,000,000 credits (13,031,123)PSP LLR Turquoise: Earned 5,000,000 credits (6,084,153)SoB LLR Jade: Earned 10,000,000 credits (19,735,682)SR5 LLR Ruby: Earned 2,000,000 credits (3,158,684)SGS LLR Ruby: Earned 2,000,000 credits (3,121,612)TRP LLR Turquoise: Earned 5,000,000 credits (7,922,107)Woodall LLR Turquoise: Earned 5,000,000 credits (5,099,498)321 Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,834,160)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (2,647,915)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,373,349)PPS Sieve Double Silver: Earned 200,000,000 credits (217,760,089)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (4,080,038)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (7,803,337)AP 26/27 Double Bronze: Earned 100,000,000 credits (113,135,269)WW Double Silver: Earned 200,000,000 credits (211,560,000)GFN Double Silver: Earned 200,000,000 credits (301,555,072)PSA Double Amethyst: Earned 1,000,000,000 credits (1,863,027,834)
Message 146149 - Posted: 5 Dec 2020 | 14:26:03 UTC

Change the Job Control setting from unlimited to a reasonable maximum number of tasks.
____________

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13633
ID: 53948
Credit: 279,373,277
RAC: 150,905
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,132,712)Cullen LLR Ruby: Earned 2,000,000 credits (4,960,917)ESP LLR Turquoise: Earned 5,000,000 credits (6,177,890)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Sapphire: Earned 20,000,000 credits (20,751,038)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (3,718,606)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Ruby: Earned 2,000,000 credits (2,963,361)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,118,303)WW Sapphire: Earned 20,000,000 credits (31,424,000)GFN Emerald: Earned 50,000,000 credits (77,916,132)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 146152 - Posted: 5 Dec 2020 | 14:29:40 UTC - in response to Message 146149.

Change the Job Control setting from unlimited to a reasonable maximum number of tasks.


This is NOT what this control is for, and it can have unintended consequences if used in this manner. Very strongly NOT recommended.
____________
My lucky number is 75898524288+1

Peter Hucker
Send message
Joined: 23 Sep 06
Posts: 115
ID: 3541
Credit: 46,730,776
RAC: 67,767
321 LLR Silver: Earned 100,000 credits (117,162)Cullen LLR Silver: Earned 100,000 credits (199,800)ESP LLR Bronze: Earned 10,000 credits (99,691)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (100,048)PPS LLR Bronze: Earned 10,000 credits (29,800)PSP LLR Silver: Earned 100,000 credits (296,161)SoB LLR Amethyst: Earned 1,000,000 credits (1,376,215)SR5 LLR Bronze: Earned 10,000 credits (39,698)SGS LLR Bronze: Earned 10,000 credits (18,533)TRP LLR Bronze: Earned 10,000 credits (62,235)Woodall LLR Silver: Earned 100,000 credits (240,222)321 Sieve (suspended) Bronze: Earned 10,000 credits (30,838)PPS Sieve Ruby: Earned 2,000,000 credits (2,509,768)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,965)TRP Sieve (suspended) Bronze: Earned 10,000 credits (14,492)AP 26/27 Ruby: Earned 2,000,000 credits (4,432,423)WW Silver: Earned 100,000 credits (484,000)GFN Sapphire: Earned 20,000,000 credits (36,621,124)
Message 146153 - Posted: 5 Dec 2020 | 14:32:56 UTC - in response to Message 146062.
Last modified: 5 Dec 2020 | 14:41:36 UTC

No one wants to be DCer, right?


Weeeeellllllll maybe...in todays World of someone always being able to get faster and better hardware being the DC'er is much better than being nothing at all. Nothing at all being those that aborted the task or for some reason the task errored out and had to be resent to someone else. NO I'm not denigrating those that the task times out on or choose to abort the task for whatever reason or those that for some reason the tasks fails to complete correctly...they are a fact of crunching.

And a lot of aborts for me due to getting way too much work from Primegrid. Hopefully Boinc will sort this major bug. I'm getting days instead of hours given to my 24 core machines.

Peter Hucker
Send message
Joined: 23 Sep 06
Posts: 115
ID: 3541
Credit: 46,730,776
RAC: 67,767
321 LLR Silver: Earned 100,000 credits (117,162)Cullen LLR Silver: Earned 100,000 credits (199,800)ESP LLR Bronze: Earned 10,000 credits (99,691)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (100,048)PPS LLR Bronze: Earned 10,000 credits (29,800)PSP LLR Silver: Earned 100,000 credits (296,161)SoB LLR Amethyst: Earned 1,000,000 credits (1,376,215)SR5 LLR Bronze: Earned 10,000 credits (39,698)SGS LLR Bronze: Earned 10,000 credits (18,533)TRP LLR Bronze: Earned 10,000 credits (62,235)Woodall LLR Silver: Earned 100,000 credits (240,222)321 Sieve (suspended) Bronze: Earned 10,000 credits (30,838)PPS Sieve Ruby: Earned 2,000,000 credits (2,509,768)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (16,965)TRP Sieve (suspended) Bronze: Earned 10,000 credits (14,492)AP 26/27 Ruby: Earned 2,000,000 credits (4,432,423)WW Silver: Earned 100,000 credits (484,000)GFN Sapphire: Earned 20,000,000 credits (36,621,124)
Message 146154 - Posted: 5 Dec 2020 | 14:36:12 UTC - in response to Message 146043.

I agree with Jeppe's solution:
for non-LLR2 projects (WW, AP, all GFNs, PPSE, SGS), it is highly recommended that you DO NOT have a bunker of more than 0.

These tasks are sent out in magnitudes of two, and in the case of a prime, the user who crunched the first returned task will be primary finder and the second user double checker. If two users have the same computing force, and one user has a bunker, then the user who doesn't will process that task immediately while the one with a bunker will most probably process some other tasks before getting to this prime one. And therefore resulting in being double checker.
No one wants to be DCer, right?

I'm not doing it for fame, I'm doing it to help out. I don't see it as a race, although I do like the credits so I can see how much work I've done compared to others, but not how quickly, just how much.

Post to thread

Message boards : Number crunching : Giving out too much work

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2021 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 3.07, 2.04, 1.81
Generated 20 Jun 2021 | 19:00:33 UTC