PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Generalized Fermat Prime Search : Do You Feel Lucky? Jumped from 2+ days to 6+ days remaining. Why?

Author Message
CyborgSam
Send message
Joined: 1 Mar 23
Posts: 3
ID: 1565684
Credit: 33,763,799
RAC: 451,968
PPS Sieve Silver: Earned 100,000 credits (104,501)GFN Sapphire: Earned 20,000,000 credits (33,659,298)
Message 160895 - Posted: 4 Mar 2023 | 2:00:59 UTC

MacBook Pro 16" M1 Max 64GB RAM running Ventura 13.2.1.

BOINC veteran but new to PrimeGrid.

DYFL? genefer_extreme_68937150_2 (executable genefer22g_macarm64_22.11.04) running on 0.000635 CPUs & Apple M1 Max GPU. The other 9 CPU cores are loaded with Einstein tasks, nothing else using the GPU.

I shut down then restarted less than 15 minutes later. The task jumped from less than 2 days remaining to over 6 days. In 5 hours it's only come down to 5 days 14 hours.

The task is at 47% completion in 30 hours, on target for the original 2+ days. Calculating the % progress since the restart also results in the original 2+ days.

I understand that check-pointing isn't an exact science for most BOINC tasks. BOINC is set to checkpoint at most every 60 seconds.

Any explanation of what went amok?

TIA,
Sam

Yves GallotProject donor
Volunteer developer
Project scientist
Send message
Joined: 19 Aug 12
Posts: 820
ID: 164101
Credit: 305,989,513
RAC: 1,728
GFN Double Silver: Earned 200,000,000 credits (305,989,513)
Message 160897 - Posted: 4 Mar 2023 | 8:20:39 UTC - in response to Message 160895.

Remaining time is always incorrect with Boinc. It evaluates complex statistics and generates a wrong estimate.
The simple formula elapsed = progress * total and then remaining = elapsed / progress - elapsed is accurate.
I don't know why Boinc doesn't use this relation and if it will be fixed one of these days.

Note that check-pointing and progress are two independent features. One checkpoint every 60 seconds for a long task is too much. During a checkpoint, CPU and GPU are synchronized, GPU memory is read and written to the disk. That slows the system down. 600 seconds is sufficient.

Profile mikey
Avatar
Send message
Joined: 17 Mar 09
Posts: 1788
ID: 37043
Credit: 793,475,008
RAC: 1,211,045
Discovered 2 mega primesFound 12 primes in the 2023 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,008,621)Cullen LLR Ruby: Earned 2,000,000 credits (2,074,615)ESP LLR Ruby: Earned 2,000,000 credits (2,243,517)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,142,353)PPS LLR Turquoise: Earned 5,000,000 credits (7,296,858)PSP LLR Ruby: Earned 2,000,000 credits (2,232,103)SoB LLR Ruby: Earned 2,000,000 credits (2,934,612)SR5 LLR Ruby: Earned 2,000,000 credits (2,071,823)SGS LLR Turquoise: Earned 5,000,000 credits (6,780,752)TRP LLR Turquoise: Earned 5,000,000 credits (5,023,333)Woodall LLR Turquoise: Earned 5,000,000 credits (5,047,133)321 Sieve (suspended) Sapphire: Earned 20,000,000 credits (23,770,672)Cullen/Woodall Sieve Jade: Earned 10,000,000 credits (15,648,748)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,813,253)PPS Sieve Double Silver: Earned 200,000,000 credits (379,578,052)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,446,797)AP 26/27 Emerald: Earned 50,000,000 credits (83,269,628)GFN Double Bronze: Earned 100,000,000 credits (140,631,387)WW (retired) Emerald: Earned 50,000,000 credits (64,048,000)PSA Sapphire: Earned 20,000,000 credits (20,457,430)
Message 160899 - Posted: 4 Mar 2023 | 11:44:41 UTC - in response to Message 160895.

MacBook Pro 16" M1 Max 64GB RAM running Ventura 13.2.1.

BOINC veteran but new to PrimeGrid.

DYFL? genefer_extreme_68937150_2 (executable genefer22g_macarm64_22.11.04) running on 0.000635 CPUs & Apple M1 Max GPU. The other 9 CPU cores are loaded with Einstein tasks, nothing else using the GPU.

I shut down then restarted less than 15 minutes later. The task jumped from less than 2 days remaining to over 6 days. In 5 hours it's only come down to 5 days 14 hours.

The task is at 47% completion in 30 hours, on target for the original 2+ days. Calculating the % progress since the restart also results in the original 2+ days.

TIA,
Sam


Most projects advise us to wait until at least 10 tasks, of the same kind, have been processed to get a good handle on the actual time it takes to run a task. Prime Grid tasks are no different in other projects long tasks in that they tend to over estimate rather than under estimate the actual time it will take to finish a task when we get new for us tasks.

Profile pschoeferProject donor
Volunteer developer
Volunteer tester
Avatar
Send message
Joined: 20 Sep 05
Posts: 686
ID: 845
Credit: 2,910,184,413
RAC: 199,509
Discovered 1 mega primeFound 2 primes in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 2 primes in the 2020 Tour de PrimesFound 1 prime in the 2020 Tour de Primes Mountain StageFound 2 primes in the 2021 Tour de PrimesFound 1 prime in the 2022 Tour de PrimesFound 4 primes in the 2023 Tour de PrimesFound 2 primes in the 2023 Tour de Primes Mountain Stage321 LLR Turquoise: Earned 5,000,000 credits (8,210,672)Cullen LLR Jade: Earned 10,000,000 credits (10,017,177)ESP LLR Jade: Earned 10,000,000 credits (15,505,816)Generalized Cullen/Woodall LLR Sapphire: Earned 20,000,000 credits (21,844,941)PPS LLR Sapphire: Earned 20,000,000 credits (26,776,022)PSP LLR Jade: Earned 10,000,000 credits (15,424,893)SoB LLR Sapphire: Earned 20,000,000 credits (32,550,307)SR5 LLR Sapphire: Earned 20,000,000 credits (25,191,523)SGS LLR Turquoise: Earned 5,000,000 credits (9,366,270)TPS LLR (retired) Bronze: Earned 10,000 credits (76,372)TRP LLR Sapphire: Earned 20,000,000 credits (31,679,964)Woodall LLR Jade: Earned 10,000,000 credits (12,256,870)321 Sieve (suspended) Jade: Earned 10,000,000 credits (11,111,528)Cullen/Woodall Sieve Sapphire: Earned 20,000,000 credits (20,000,264)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (11,111,347)PPS Sieve Double Gold: Earned 500,000,000 credits (502,653,246)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (3,177,104)TRP Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,556,644)AP 26/27 Double Bronze: Earned 100,000,000 credits (167,836,939)GFN Double Gold: Earned 500,000,000 credits (566,637,101)WW (retired) Double Silver: Earned 200,000,000 credits (333,336,000)PSA Double Amethyst: Earned 1,000,000,000 credits (1,079,860,880)
Message 160901 - Posted: 4 Mar 2023 | 12:51:49 UTC - in response to Message 160897.

Remaining time is always incorrect with Boinc. It evaluates complex statistics and generates a wrong estimate.
The simple formula elapsed = progress * total and then remaining = elapsed / progress - elapsed is accurate.
I don't know why Boinc doesn't use this relation and if it will be fixed one of these days.

BOINC does not use this relation by default, because some applications have progress bars that are inaccurate or do not update very often, or have no progress bar at all. However, both the project and the user (via app_config.xml) already can tell the client to use the simple linear interpolation (fraction_done_exact). PrimeGrid actually does this, but it looks like it does not work after a restart.
____________

CyborgSam
Send message
Joined: 1 Mar 23
Posts: 3
ID: 1565684
Credit: 33,763,799
RAC: 451,968
PPS Sieve Silver: Earned 100,000 credits (104,501)GFN Sapphire: Earned 20,000,000 credits (33,659,298)
Message 160912 - Posted: 4 Mar 2023 | 20:51:45 UTC - in response to Message 160897.

Note that check-pointing and progress are two independent features. One checkpoint every 60 seconds for a long task is too much. During a checkpoint, CPU and GPU are synchronized, GPU memory is read and written to the disk. That slows the system down. 600 seconds is sufficient.


I didn't know that, thanks. I changed the checkpoint to 600. PrimeGrid is the only project (that I know of) using the M1's GPU.

CyborgSam
Send message
Joined: 1 Mar 23
Posts: 3
ID: 1565684
Credit: 33,763,799
RAC: 451,968
PPS Sieve Silver: Earned 100,000 credits (104,501)GFN Sapphire: Earned 20,000,000 credits (33,659,298)
Message 160913 - Posted: 4 Mar 2023 | 20:54:34 UTC - in response to Message 160901.

BOINC does not use this relation by default, because some applications have progress bars that are inaccurate or do not update very often, or have no progress bar at all. However, both the project and the user (via app_config.xml) already can tell the client to use the simple linear interpolation (fraction_done_exact). PrimeGrid actually does this, but it looks like it does not work after a restart.


Thanks, now it makes perfect sense. BOINC's feeble attempts to update this accurately say it's down to 2 days when it only has about 12 hours to go.

I may do an app_config.xml just so this is more linear.

Post to thread

Message boards : Generalized Fermat Prime Search : Do You Feel Lucky? Jumped from 2+ days to 6+ days remaining. Why?

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2023 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 0.62, 1.02, 1.31
Generated 7 Jun 2023 | 1:44:24 UTC