Join PrimeGrid
Returning Participants
Community
Leader Boards
Results
Other
drummers-lowrise
|
Message boards :
Cullen/Woodall prime search :
CW sieve lifetime
| Author |
Message |
streamVolunteer moderator Project administrator Volunteer developer Volunteer tester Send message
Joined: 1 Mar 14 Posts: 1186 ID: 301928 Credit: 777,527,568 RAC: 0
                              
|
|
An optimal sieving depth is a point where checking candidates for primes is faster than removing them by sieving. Determining optimal sieving depth for CW sieve is very difficult because sieving is done on GPU, but crunching on CPU. We have to compare incomparable things with completely different architecture. An answer will depend on many factors - what and how we'll compare. For example,
- Should we compare runtime of single core or CPU chip as a whole?
- Which CPU and GPU should be used for benchmarks? Should we use common desktop models or, since new CW candidates will be tested in the future, use top AVX-512 models because they'll be common after few years?
This leads to lot of possible combinations. Some of them will give an answer "Yes, go on, sieving it still 20x effective", some of them will give "Stop immediately, it's already oversieved".
Finally, following rules were chosen:
- "Chip vs chip" is compared, i.e. runtime of one GPU is compared with runtime of one CPU running all threads in most efficient mode;
- "Almost topmost" CPU and GPU were chosen for benchmarks - Ryzen 7900X (AVX-512, running 2 tasks 6 cores each) and 4070 TI.
This gives following efficiency table:
Range(T) Found Removed Efficiency
------- taken from real data --------
2000 107600 24339 6,7260
3000 61582 13921 3,8470
4000 43549 9801 2,7085
5000 33267 7225 1,9966
6000 27129 5970 1,6467
7000 22951 5100 1,4094
8000 19468 4151 1,1471
9000 17592 3829 1,0581
9500 7892 1732 0,9573
------- estimated by Yves Gallot ---------
7000 5001 1,3820
8000 4298 1,1877
9000 3765 1,0404
10000 3347 0,9249
As you can see, current (at 5000T) sieve efficiency for given parameters is about 2.0, i.e. sieving removes candidates two times faster than it's possible to do with LLR. We can run sieving for a while.
How long will CW sieving project lasts?
After completion of every 1000T range, I'll calculate number of factors removed in this range and corresponding sieve efficiency. When efficiency will be very close to or drops below 1.0, a 30-days official warning will be issued. Work will be available at least for 30 days. We can extend project a bit more to finish it at some round value, but amount of such extension will be unpredictable, so don't rely much on it.
Looking how efficiency drops, it's possible that shutdown sequence will be initiated after 7000T or 8000T.
The project was finished at p=9500T. | |
|
|
|
|
Thanks for making a post about the methodology.
____________
| |
|
tng Send message
Joined: 29 Aug 10 Posts: 650 ID: 66603 Credit: 80,061,613,466 RAC: 31,885,995
                                                                  
|
|
Interestingly, Yves provided some calculations on power efficiency for the sieve on Discord. Using a 7950X for comparison, the crossover for power efficiency came out a bit under 8000T. So this eems likely to come out close to that calculation.
____________
| |
|
|
|
Range(T) Found Removed Efficiency
2000 107600 24339 6,7260
3000 61582 13921 3,8470
4000 43549 9801 2,7085
5000 33267 7225 1,9966
[...]
Looking how efficiency drops, it's possible that shutdown sequence will be initiated after 7000P or 8000P.
Using the estimate Remaining candidates ~ 43e6 / log(p_max), we have
Range Remaining Removed (expected)
1000 1244978
2000 1220484 24493
3000 1206598 13886
4000 1196936 9662
5000 1189547 7389
6000 1183577 5970
7000 1178577 5001
8000 1174279 4298
9000 1170514 3765
10000 1167166 3347
My calculations are about the same except a correcting factor corresponding to the power ratio:
RTX 4070 Ti: 285W, Ryzen 9 7900X: 170W => 1.676 for the electricity bill. | |
|
|
|
|
Many thanks for going to the trouble to quantify matters, Yves.
Hopefully there is a bit more time for the dinosaurs of the group to crunch for a little while longer. Foot on the gas pedal on a 24/7 basis.
I particularly like the target specified (ex 7000T, 8000T) and which anyone can easily monitor from the project task page. | |
|
Honza Volunteer moderator Volunteer tester Project scientist Send message
Joined: 15 Aug 05 Posts: 2082 ID: 352 Credit: 9,723,542,791 RAC: 2,477,993
                                                   
|
|
My recent task is 6008748e9, which is about 6008T.
There are 1000/150 WUs to do 1T, we are doing ~4k tasks per day, two are needed in a WU so about 10-15T per day.
Is it correct?
Looking at CW sieve status, it looks a bit ahead or status page is not updated to current leading edge.
Trying to estimate how long before we reach 7000T or 8000T...?
____________
My stats | |
|
|
|
- "Chip vs chip" is compared, i.e. runtime of one GPU is compared with runtime of one CPU running all threads in most efficient mode;
Sieve tasks are DC but primality tests are not. Then the runtime of one GPU must be doubled to take this factor into account.
Just in case this variable has been left out of the efficiency table.
| |
|
mikey Send message
Joined: 17 Mar 09 Posts: 2522 ID: 37043 Credit: 1,163,791,181 RAC: 94,918
                            
|
An optimal sieving depth is a point where checking candidates for primes is faster than removing them by sieving. Determining optimal sieving depth for CW sieve is very difficult because sieving is done on GPU, but crunching on CPU. We have to compare incomparable things with completely different architecture. An answer will depend on many factors - what and how we'll compare. For example,
- Should we compare runtime of single core or CPU chip as a whole?
- Which CPU and GPU should be used for benchmarks? Should we use common desktop models or, since new CW candidates will be tested in the future, use top AVX-512 models because they'll be common after few years?
This leads to lot of possible combinations. Some of them will give an answer "Yes, go on, sieving it still 20x effective", some of them will give "Stop immediately, it's already oversieved".
Finally, following rules were chosen:
- "Chip vs chip" is compared, i.e. runtime of one GPU is compared with runtime of one CPU running all threads in most efficient mode;
- "Almost topmost" CPU and GPU were chosen for benchmarks - Ryzen 7900X (AVX-512, running 2 tasks 6 cores each) and 4070 TI.
This gives following efficiency table:
Range(T) Found Removed Efficiency
------- taken from real data --------
2000 107600 24339 6,7260
3000 61582 13921 3,8470
4000 43549 9801 2,7085
5000 33267 7225 1,9966
------- estimated by Yves Gallot ---------
6000 5970 1,6498
7000 5001 1,3820
8000 4298 1,1877
9000 3765 1,0404
10000 3347 0,9249
As you can see, current (at 5000T) sieve efficiency for given parameters is about 2.0, i.e. sieving removes candidates two times faster than it's possible to do with LLR. We can run sieving for a while.
How long will CW sieving project lasts?
After completion of every 1000P range, I'll calculate number of factors removed in this range and corresponding sieve efficiency. When efficiency will be very close to or drops below 1.0, a 30-days official warning will be issued. Work will be available at least for 30 days. We can extend project a bit more to finish it at some round value, but amount of such extension will be unpredictable, so don't rely much on it.
Looking how efficiency drops, it's possible that shutdown sequence will be initiated after 7000P or 8000P.
My question would be why stop even when the efficiency is nearly 1:1? If you are clearing them at the same rate, or nearly the same rate on both why stop one over the other? Even the last estimation is only 0,9249 which is only slightly less efficient that a cpu and that's at the 10kP range. Even assuming those numbers hold that seems to me to still be at the point where both cpu and gpu people can crunch them pretty effectively. Yes cpu's and gpu's will both expand their capabilities going forward and that to me means as you said that the numbers need to be rerun periodically to see how they are holding up but to me even at nearly identical ratios why shut down one over the other? | |
|
Jay Send message
Joined: 27 Feb 10 Posts: 146 ID: 56067 Credit: 77,754,303 RAC: 18,223
                       
|
My question would be why stop even when the efficiency is nearly 1:1?
I have no input in the discussion or decision, but in my mind you stop at 1:1 because the goal is to find primes, not to eliminate candidates. Yes, eliminating candidates makes find primes more efficient. But why sieve and maintain a list of candidates that won't be tested for a long long time?
There is a chance that new technology may come about, or a new process that tests much much faster but won't make use of the sieved file. And if not, the sieve process can always be restarted again in the future. It went away for a while and came back once. It could do so again when needed. | |
|
streamVolunteer moderator Project administrator Volunteer developer Volunteer tester Send message
Joined: 1 Mar 14 Posts: 1186 ID: 301928 Credit: 777,527,568 RAC: 0
                              
|
My question would be why stop even when the efficiency is nearly 1:1?
- As already mentioned above, a goal of PG is to find primes. You cannot find primes in sieving. As for composites, if CPU can eliminate a candidate faster, do it on CPU.
- GPU is a powerful and rare resource (comparing to fleet of desktop PC's) which should used in most optimal way. For example, to find GFN primes or do other discoveries in projects which are optimized for GPU.
At current participation rate, we can do 1000P in 25 days. Considering Yves' prediction, it leads to following tentative plan:
- A 30-days warning can be issued at 8000P.
- After 30 days, the leading edge should be slightly above 9000P. Final stop point will be selected at 9500P or 10000P, giving efficiency ratio of 1.0 or slightly below.
Of course these numbers can be changed depending on real participation rate. But the main rule is: the project should not go above 10000P. | |
|
RafaelVolunteer tester
 Send message
Joined: 22 Oct 14 Posts: 1002 ID: 370496 Credit: 1,079,113,068 RAC: 410,304
                                  
|
My question would be why stop even when the efficiency is nearly 1:1?
- As already mentioned above, a goal of PG is to find primes. You cannot find primes in sieving. As for composites, if CPU can eliminate a candidate faster, do it on CPU.
- GPU is a powerful and rare resource (comparing to fleet of desktop PC's) which should used in most optimal way. For example, to find GFN primes or do other discoveries in projects which are optimized for GPU.
Wasn't PPS-SV already way oversieved and only really kept alive for the sake of offering something to run on GPUs other tahn GFN, which not all cards support? Is CW-SV in the same boat of not running on older hardware?
At current participation rate, we can do 1000P in 25 days. Considering Yves' prediction, it leads to following tentative plan:
- A 30-days warning can be issued at 8000P.
- After 30 days, the leading edge should be slightly above 9000P. Final stop point will be selected at 9500P or 10000P, giving efficiency ratio of 1.0 or slightly below.
Of course these numbers can be changed depending on real participation rate. But the main rule is: the project should not go above 10000P.
So we're probably looking at 2~4 months of work left. | |
|
streamVolunteer moderator Project administrator Volunteer developer Volunteer tester Send message
Joined: 1 Mar 14 Posts: 1186 ID: 301928 Credit: 777,527,568 RAC: 0
                              
|
Wasn't PPS-SV already way oversieved and only really kept alive for the sake of offering something to run on GPUs other tahn GFN, which not all cards support? Is CW-SV in the same boat of not running on older hardware?
No. PPS-SV recently switched to 9M-12M range, this range is far from optimal point.
It's a CPU part of PPS-SV which is inefficient and offered only as default project which will not burn novice users' computers.
| |
|
|
|
|
If the September and December challenges can be switched, we could artificially add around 10 days to the life of the sieve. | |
|
|
|
My question would be why stop even when the efficiency is nearly 1:1?
- As already mentioned above, a goal of PG is to find primes. You cannot find primes in sieving. As for composites, if CPU can eliminate a candidate faster, do it on CPU.
- GPU is a powerful and rare resource (comparing to fleet of desktop PC's) which should used in most optimal way. For example, to find GFN primes or do other discoveries in projects which are optimized for GPU.
At current participation rate, we can do 1000P in 25 days. Considering Yves' prediction, it leads to following tentative plan:
- A 30-days warning can be issued at 8000P.
- After 30 days, the leading edge should be slightly above 9000P. Final stop point will be selected at 9500P or 10000P, giving efficiency ratio of 1.0 or slightly below.
Of course these numbers can be changed depending on real participation rate. But the main rule is: the project should not go above 10000P.
Did you mean 10000T instead of 10000P?
Anyway, the leading edge is currently a bit above 9000T, so I wonder whether we'll be getting a 30-day warning soon. I'm going to upgrade my CW-Sieve badge while I still can :)
____________
My largest prime: 213*2^4865126+1 (1,464,552 digits)
My favorite sequence: 605185576317848261+155368778*23#*n for n=0..26
My pictures: https://www.flickr.com/people/michael-kwok/ | |
|
RafaelVolunteer tester
 Send message
Joined: 22 Oct 14 Posts: 1002 ID: 370496 Credit: 1,079,113,068 RAC: 410,304
                                  
|
Did you mean 10000T instead of 10000P?
Nope, 10 000P is correct.
Anyway, the leading edge is currently a bit above 9000T, so I wonder whether we'll be getting a 30-day warning soon. I'm going to upgrade my CW-Sieve badge while I still can :)
Are you in the discord? I post bi-weekly updates on Mon and Thursdays.
But since you asked, current plan is to end at 9500P. Production is down in the dumps right now due to GFN challenge sucking up all the GPU hardware, which is putting the ETA at Jan 18th; before that, it was hovering around the 4-9th mark. | |
|
|
|
Did you mean 10000T instead of 10000P?
Nope, 10 000P is correct.
Anyway, the leading edge is currently a bit above 9000T, so I wonder whether we'll be getting a 30-day warning soon. I'm going to upgrade my CW-Sieve badge while I still can :)
Are you in the discord? I post bi-weekly updates on Mon and Thursdays.
But since you asked, current plan is to end at 9500P. Production is down in the dumps right now due to GFN challenge sucking up all the GPU hardware, which is putting the ETA at Jan 18th; before that, it was hovering around the 4-9th mark.
Thanks for letting me know the Jan 18 ETA; I rarely go on the discord.
Anyway, are you sure about it being 10 000P? The subproject status at: https://www.primegrid.com/stats_cw_sieve.php states -
Range: 9040T - 9050T
Total workunits: 1667
Queued for download: 446
In progress: 483
Completed: 738
I also checked a recent workunit I did:
Starting sieve at p: 9046932 000 000 000 n: 25000000 k: 25000000
Stopping sieve at P: 9046938 000 000 000 N: 50000000 K: 50000000
So that's 9046932G - 9046938G (9046.932T - 9046.938T), not 9046P.
The first post from late July also says:
As you can see, current (at 5000T) sieve efficiency for given parameters is about 2.0, i.e. sieving removes candidates two times faster than it's possible to do with LLR.
which would be consistent with a stop point of 9500T, not 9500P.
____________
My largest prime: 213*2^4865126+1 (1,464,552 digits)
My favorite sequence: 605185576317848261+155368778*23#*n for n=0..26
My pictures: https://www.flickr.com/people/michael-kwok/ | |
|
RafaelVolunteer tester
 Send message
Joined: 22 Oct 14 Posts: 1002 ID: 370496 Credit: 1,079,113,068 RAC: 410,304
                                  
|
Did you mean 10000T instead of 10000P?
Nope, 10 000P is correct.
Anyway, the leading edge is currently a bit above 9000T, so I wonder whether we'll be getting a 30-day warning soon. I'm going to upgrade my CW-Sieve badge while I still can :)
Are you in the discord? I post bi-weekly updates on Mon and Thursdays.
But since you asked, current plan is to end at 9500P. Production is down in the dumps right now due to GFN challenge sucking up all the GPU hardware, which is putting the ETA at Jan 18th; before that, it was hovering around the 4-9th mark.
Thanks for letting me know the Jan 18 ETA; I rarely go on the discord.
Anyway, are you sure about it being 10 000P? The subproject status at: https://www.primegrid.com/stats_cw_sieve.php states -
Range: 9040T - 9050T
Total workunits: 1667
Queued for download: 446
In progress: 483
Completed: 738
I also checked a recent workunit I did:
Starting sieve at p: 9046932 000 000 000 n: 25000000 k: 25000000
Stopping sieve at P: 9046938 000 000 000 N: 50000000 K: 50000000
So that's 9046932G - 9046938G (9046.932T - 9046.938T), not 9046P.
The first post from late July also says:
As you can see, current (at 5000T) sieve efficiency for given parameters is about 2.0, i.e. sieving removes candidates two times faster than it's possible to do with LLR.
which would be consistent with a stop point of 9500T, not 9500P.
Oh mb, I just skimmed through the post and thought the problem was an extra 0, not the unit of measure. Regardless, doesn't change anything, the ETA is still correct. | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14706 ID: 53948 Credit: 1,042,938,327 RAC: 8
                                           
|
Anyway, the leading edge is currently a bit above 9000T, so I wonder whether we'll be getting a 30-day warning soon. I'm going to upgrade my CW-Sieve badge while I still can :)
The 30 day warning was given in September. It turned out to be a bit more than 30 days, for various reasons.
Don't assume you're going to get another warning. If you have CW Sieve goals, get them done. If people start crunching it for reason XYZ, it will go fast. All it takes is a rumor that it's going to end earlier than expected and that will become a self-fulfilling prophecy.
____________
My lucky number is 75898524288+1 | |
|
Message boards :
Cullen/Woodall prime search :
CW sieve lifetime |