PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Problems and Help : Way WAY WAYYYY to much work

Author Message
Profile skildude
Send message
Joined: 18 Jul 08
Posts: 57
ID: 25792
Credit: 504,970,329
RAC: 372,553
Discovered 1 mega prime321 LLR Amethyst: Earned 1,000,000 credits (1,129,083)Cullen LLR Amethyst: Earned 1,000,000 credits (1,429,302)ESP LLR Amethyst: Earned 1,000,000 credits (1,055,874)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,313,679)PPS LLR Turquoise: Earned 5,000,000 credits (7,878,995)PSP LLR Ruby: Earned 2,000,000 credits (2,975,354)SoB LLR Amethyst: Earned 1,000,000 credits (1,661,184)SR5 LLR Amethyst: Earned 1,000,000 credits (1,316,120)SGS LLR Amethyst: Earned 1,000,000 credits (1,117,332)TRP LLR Turquoise: Earned 5,000,000 credits (7,729,610)Woodall LLR Amethyst: Earned 1,000,000 credits (1,566,219)321 Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,652,732)Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (35,130)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,761,723)PPS Sieve Sapphire: Earned 20,000,000 credits (20,438,824)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Silver: Earned 100,000 credits (142,057)TRP Sieve (suspended) Gold: Earned 500,000 credits (611,674)AP 26/27 Ruby: Earned 2,000,000 credits (4,051,744)GFN Double Silver: Earned 200,000,000 credits (201,173,648)WW Double Bronze: Earned 100,000,000 credits (175,512,000)PSA Emerald: Earned 50,000,000 credits (69,417,300)
Message 101386 - Posted: 28 Nov 2016 | 4:00:10 UTC

BOINC/Primegrid is grossly overestimating my CPU's ability to complete tasks. I've been watching my account over the last couple of months I've found that I either have to abort the tasks or BOINC will eventually do it.

The problem is the BOINC/Primegrid insists on sending more work with very short TAT and I'm aborting more tasks.

I've got my system to have 0.25 days of extra work which shouldn't allow that much.

I aborted several tasks as they wouldn't be started by the deadline. BOINC immediately sent me 34 more tasks that expired on december 1. These tasks wont be started until the 29th of this month. I've done the best case scenario. thats 275 hours of work over 7 cores. thats about 39 1/4 hours of work in 48 hours. That only works if I don't play any video games (which I do) during that time. BOINC should see that it only has so many hours a day to run tasks and not attempt to fill every single moment with a WU.

A simple easy solution is to move back the TAT date by a few days. Thats for every project on Primegrid. I'm getting a bit tired of having so many abandoned WU's when its just so unnecessary. You guys are clearly wasting so much bandwidth as I've seen so many WU's just sit. I can't believe that everyone is just quitting the project and not completing the work. This appears to me to be a problem with attempts to overfeed CPU's and wasting both of our time.

Profile Rafael
Volunteer tester
Avatar
Send message
Joined: 22 Oct 14
Posts: 905
ID: 370496
Credit: 459,403,918
RAC: 159,669
321 LLR Jade: Earned 10,000,000 credits (10,008,611)Cullen LLR Jade: Earned 10,000,000 credits (10,005,009)ESP LLR Jade: Earned 10,000,000 credits (10,041,747)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,000,820)PPS LLR Jade: Earned 10,000,000 credits (10,020,730)PSP LLR Jade: Earned 10,000,000 credits (10,049,767)SoB LLR Jade: Earned 10,000,000 credits (13,698,824)SR5 LLR Jade: Earned 10,000,000 credits (10,003,746)SGS LLR Jade: Earned 10,000,000 credits (10,002,215)TRP LLR Jade: Earned 10,000,000 credits (10,011,903)Woodall LLR Jade: Earned 10,000,000 credits (10,076,850)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,033,828)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (10,037,204)PPS Sieve Jade: Earned 10,000,000 credits (10,305,147)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,000,053)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,030,160)AP 26/27 Emerald: Earned 50,000,000 credits (50,015,953)GFN Sapphire: Earned 20,000,000 credits (39,587,351)WW Emerald: Earned 50,000,000 credits (50,712,000)PSA Double Bronze: Earned 100,000,000 credits (170,761,999)
Message 101387 - Posted: 28 Nov 2016 | 4:18:08 UTC - in response to Message 101386.

BOINC/Primegrid is grossly overestimating my CPU's ability to complete tasks. I've been watching my account over the last couple of months I've found that I either have to abort the tasks or BOINC will eventually do it.

The problem is the BOINC/Primegrid insists on sending more work with very short TAT and I'm aborting more tasks.

I've got my system to have 0.25 days of extra work which shouldn't allow that much.

I aborted several tasks as they wouldn't be started by the deadline. BOINC immediately sent me 34 more tasks that expired on december 1. These tasks wont be started until the 29th of this month. I've done the best case scenario. thats 275 hours of work over 7 cores. thats about 39 1/4 hours of work in 48 hours. That only works if I don't play any video games (which I do) during that time. BOINC should see that it only has so many hours a day to run tasks and not attempt to fill every single moment with a WU.

A simple easy solution is to move back the TAT date by a few days. Thats for every project on Primegrid. I'm getting a bit tired of having so many abandoned WU's when its just so unnecessary. You guys are clearly wasting so much bandwidth as I've seen so many WU's just sit. I can't believe that everyone is just quitting the project and not completing the work. This appears to me to be a problem with attempts to overfeed CPU's and wasting both of our time.

Note #1: If your PC has started a task and it reports continuous back to the server, the deadline will be extended. So while downloading too much work is never a good thing, don't abort work that you've started already, but won't meet the deadline.

Note #2: If 0.25 days of extra work is too much... well, then simply lower that number. In fact, most of us here usually go with 0 buffer at all, and that's the recommended way to go about it. Though if you can't (say, PC is not often connected to the internet), then I guess you could make do with 0.1 days of work. As for wrong estimates, don't worry, that happens to everyone, and there's no real way to fix it either.

Note #3: FX CPUs are bad at LLR work and tasks take forever (when compared to Intel CPUs). Now, that's not to say that you can't crunch whatever you want, but I recommend avoiding the heavy hitters such as SoB, CUL or WOO. That's just a suggestion, though.

Note #4: you have 2 inconclusive tasks on your PC, which is a bad sign. This could be caused by a number of things, but the 2 big ones would be: A- a not so stable OC; B- heat is building up. Try giving your PC a good ol' de-dust section and monitor your temps, this could be a sign of a problem that's easily fixed by dust.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13780
ID: 53948
Credit: 343,945,598
RAC: 11,355
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,038,114)ESP LLR Turquoise: Earned 5,000,000 credits (6,177,890)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,416,635)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (12,245,906)SGS LLR Turquoise: Earned 5,000,000 credits (5,036,951)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Turquoise: Earned 5,000,000 credits (5,032,821)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (91,658,024)WW Emerald: Earned 50,000,000 credits (65,888,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 101389 - Posted: 28 Nov 2016 | 5:52:10 UTC - in response to Message 101386.

A simple easy solution is to move back the TAT date by a few days. Thats for every project on Primegrid. I'm getting a bit tired of having so many abandoned WU's when its just so unnecessary. You guys are clearly wasting so much bandwidth as I've seen so many WU's just sit. I can't believe that everyone is just quitting the project and not completing the work. This appears to me to be a problem with attempts to overfeed CPU's and wasting both of our time.


BOINC is notoriously terrible at scheduling. We've got it running a lot better than it used to run, but it still is awful. Just somewhat less awful than it used to be. We'd love for it to work as people would expect it to work (and by that I mean "rationally"), but we can't do that without making a major change to our server that would be very disruptive -- and we're not even a tiny bit certain it would work.

You have two options:

1) Ignore the nonsense and just let BOINC do its thing. It seems very wasteful, but what it's wasting is actually inconsequential: a tiny bit of data transfer between your host and the server. The amount of bandwidth is insignificant. The BOINC client on your host automatically aborts tasks when they haven't started by the deadline. Tasks that are already started will be completed. So your computer isn't wasting any computing -- everything it does, will count. The tasks it aborts don't hurt anything (except for us humans' sensibilities, of course.)

2) Understand the conditions that are causing this to happen, and change the way you use BOINC so that those conditions are avoided. BOINC gets REALLY confused when you have more than one type of task running on your computer. So pick one sub project, and run just that one. BOINC will learn how long those tasks take, and should eventually start making more rational decisions. Also, as Rafael said, running a cache of 0 will completely solve this problem (with the understanding that this isn't a good solution for some people.) There's another reason to run with 0 cache: it gives you the best chance of being the person who gets credit for discovering a prime as opposed to being the double checker.


____________
My lucky number is 75898524288+1

Profile skildude
Send message
Joined: 18 Jul 08
Posts: 57
ID: 25792
Credit: 504,970,329
RAC: 372,553
Discovered 1 mega prime321 LLR Amethyst: Earned 1,000,000 credits (1,129,083)Cullen LLR Amethyst: Earned 1,000,000 credits (1,429,302)ESP LLR Amethyst: Earned 1,000,000 credits (1,055,874)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,313,679)PPS LLR Turquoise: Earned 5,000,000 credits (7,878,995)PSP LLR Ruby: Earned 2,000,000 credits (2,975,354)SoB LLR Amethyst: Earned 1,000,000 credits (1,661,184)SR5 LLR Amethyst: Earned 1,000,000 credits (1,316,120)SGS LLR Amethyst: Earned 1,000,000 credits (1,117,332)TRP LLR Turquoise: Earned 5,000,000 credits (7,729,610)Woodall LLR Amethyst: Earned 1,000,000 credits (1,566,219)321 Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,652,732)Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (35,130)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,761,723)PPS Sieve Sapphire: Earned 20,000,000 credits (20,438,824)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Silver: Earned 100,000 credits (142,057)TRP Sieve (suspended) Gold: Earned 500,000 credits (611,674)AP 26/27 Ruby: Earned 2,000,000 credits (4,051,744)GFN Double Silver: Earned 200,000,000 credits (201,173,648)WW Double Bronze: Earned 100,000,000 credits (175,512,000)PSA Emerald: Earned 50,000,000 credits (69,417,300)
Message 101398 - Posted: 28 Nov 2016 | 13:02:38 UTC

while its nice to know that the system will eventually report back the work. However, This prevents me from running other projects that have long TAT. Primegrid/BOINC will ignore those tasks and fill(overfill) my Que to the point that once again I am forced to abort tasks.

I was mistaken. I actually received 49 tasks. The second grouping of tasks is slated for 2 days after the first grouping. The huge problem once again is the limited time to return tasks and the quantity of tasks.

your point 3. is not relevant. BOINC knows after so many runs how long a task takes to run. Primegrid WU's always seem to have the incorrect time assigned to them when I get them. Some either complete well before time others complete several hours after. My CPU isn't in control of how BOINC and Primegrid check times.

I don't OC and Don't have a heat problem. 45 C on water cooling is generally considered good. You assume that the problem is with my system and not the other computer involved.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 21 Jan 10
Posts: 13780
ID: 53948
Credit: 343,945,598
RAC: 11,355
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 2 mega primesFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de PrimesFound 2 primes in the 2021 Tour de PrimesFound 2 primes in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de PrimesFound 1 prime in the 2022 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (6,638,389)Cullen LLR Turquoise: Earned 5,000,000 credits (5,038,114)ESP LLR Turquoise: Earned 5,000,000 credits (6,177,890)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,094,541)PPS LLR Sapphire: Earned 20,000,000 credits (23,416,635)PSP LLR Turquoise: Earned 5,000,000 credits (7,956,186)SoB LLR Sapphire: Earned 20,000,000 credits (36,067,618)SR5 LLR Jade: Earned 10,000,000 credits (12,245,906)SGS LLR Turquoise: Earned 5,000,000 credits (5,036,951)TRP LLR Turquoise: Earned 5,000,000 credits (5,084,329)Woodall LLR Turquoise: Earned 5,000,000 credits (5,032,821)321 Sieve (suspended) Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,902,645)GFN Emerald: Earned 50,000,000 credits (91,658,024)WW Emerald: Earned 50,000,000 credits (65,888,000)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 101401 - Posted: 28 Nov 2016 | 13:38:29 UTC - in response to Message 101398.
Last modified: 28 Nov 2016 | 14:51:50 UTC

I'm sorry my earlier response (or Rafael's) wasn't satisfactory. Unfortunately, there's nothing further I can do to assist you.
____________
My lucky number is 75898524288+1

Profile Wingless WonderProject donor
Avatar
Send message
Joined: 25 Dec 12
Posts: 175
ID: 186381
Credit: 401,604,504
RAC: 1,052
Discovered 2 mega primesFound 3 primes in the 2018 Tour de Primes321 LLR Amethyst: Earned 1,000,000 credits (1,455,451)Cullen LLR Amethyst: Earned 1,000,000 credits (1,661,696)ESP LLR Gold: Earned 500,000 credits (729,408)Generalized Cullen/Woodall LLR Amethyst: Earned 1,000,000 credits (1,205,397)PPS LLR Ruby: Earned 2,000,000 credits (2,716,433)PSP LLR Ruby: Earned 2,000,000 credits (2,113,325)SoB LLR Ruby: Earned 2,000,000 credits (3,082,298)SR5 LLR Amethyst: Earned 1,000,000 credits (1,284,829)SGS LLR Gold: Earned 500,000 credits (632,629)TRP LLR Turquoise: Earned 5,000,000 credits (5,321,051)Woodall LLR Silver: Earned 100,000 credits (127,395)321 Sieve (suspended) Bronze: Earned 10,000 credits (88,433)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,626,395)PPS Sieve Double Bronze: Earned 100,000,000 credits (135,099,567)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Gold: Earned 500,000 credits (555,042)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,089,296)AP 26/27 Turquoise: Earned 5,000,000 credits (6,347,510)GFN Double Silver: Earned 200,000,000 credits (234,184,349)WW Amethyst: Earned 1,000,000 credits (1,284,000)
Message 101411 - Posted: 28 Nov 2016 | 15:27:58 UTC - in response to Message 101386.
Last modified: 28 Nov 2016 | 15:28:48 UTC

My PrimeGrid cache ceased to be a problem once I set BOINC manager to store '0' days of work and '0' days of additional work. The only thing that works consistently (EDIT: for me) is BOINC automatically downloading new work only as needed. This setting worked when I used my old AMD FX-8350 as well as my current Intel cpu.

I would only maintain a cache of work if I had crappy or intermittent internet access.

Profile Pooh Bear 27Project donor
Avatar
Send message
Joined: 10 May 09
Posts: 785
ID: 39821
Credit: 1,326,523,899
RAC: 3,752,510
Discovered 2 mega primesEliminated 1 conjecture "k"Discovered 1 twin prime2022 Tour de Primes largest primeFound 1 prime in the 2022 Tour de PrimesFound 1 mega prime in the 2022 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,709,103)Cullen LLR Turquoise: Earned 5,000,000 credits (7,681,452)ESP LLR Turquoise: Earned 5,000,000 credits (5,421,149)Generalized Cullen/Woodall LLR Jade: Earned 10,000,000 credits (10,267,839)PPS LLR Sapphire: Earned 20,000,000 credits (23,746,798)PSP LLR Jade: Earned 10,000,000 credits (12,783,817)SoB LLR Jade: Earned 10,000,000 credits (13,332,361)SR5 LLR Turquoise: Earned 5,000,000 credits (5,248,659)SGS LLR Turquoise: Earned 5,000,000 credits (6,878,856)TRP LLR Jade: Earned 10,000,000 credits (11,153,506)Woodall LLR Turquoise: Earned 5,000,000 credits (9,224,032)321 Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,000,576)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,000,977)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (6,843,367)PPS Sieve Emerald: Earned 50,000,000 credits (80,183,646)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Turquoise: Earned 5,000,000 credits (6,473,750)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (8,243,608)AP 26/27 Jade: Earned 10,000,000 credits (12,741,619)GFN Double Silver: Earned 200,000,000 credits (418,742,885)WW Double Gold: Earned 500,000,000 credits (671,864,000)PSA Turquoise: Earned 5,000,000 credits (5,042,125)
Message 101414 - Posted: 28 Nov 2016 | 17:48:42 UTC

Since you are running multiple applications at PG, and BOINC gives a score (duration correction factor) only to a single project, not each application, the problem is BOINC not being able to provide an accurate number for your machine. You also run both CPU and GPU projects, which skews that number even more. BOINC is notorious for having issues with projects that have multiple applications, especially if they are of different styles, as PG has, with Sieve, LLR, GFN and AP.

Many people have asked the BOINC people to fix this. but they have not found a good way to provide that sort of ability. So, since each project gets one DFC, it's hard for it to estimate how much work you need.

____________
My lucky numbers are 121*2^4553899-1 and 3756801695685*2^666669±1
My movie https://vimeo.com/manage/videos/502242

Message boards : Problems and Help : Way WAY WAYYYY to much work

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2022 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 0.55, 0.98, 1.07
Generated 22 May 2022 | 19:12:33 UTC