PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Number crunching : PrimeGrid Task Summary Generator

Author Message
Kellen
Send message
Joined: 10 Jan 18
Posts: 390
ID: 967938
Credit: 1,293,461,711
RAC: 6,093
Discovered 2 mega primes321 LLR Amethyst: Earned 1,000,000 credits (1,046,831)Cullen LLR Ruby: Earned 2,000,000 credits (2,380,710)ESP LLR Ruby: Earned 2,000,000 credits (2,567,223)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,266,330)PPS LLR Turquoise: Earned 5,000,000 credits (9,917,469)PSP LLR Amethyst: Earned 1,000,000 credits (1,620,415)SoB LLR Jade: Earned 10,000,000 credits (10,953,837)SR5 LLR Ruby: Earned 2,000,000 credits (2,047,778)SGS LLR Jade: Earned 10,000,000 credits (12,255,734)TRP LLR Jade: Earned 10,000,000 credits (12,784,227)Woodall LLR Sapphire: Earned 20,000,000 credits (20,017,137)321 Sieve Sapphire: Earned 20,000,000 credits (20,000,569)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,006,424)PPS Sieve Sapphire: Earned 20,000,000 credits (42,265,598)AP 26/27 Sapphire: Earned 20,000,000 credits (39,985,270)GFN Emerald: Earned 50,000,000 credits (92,346,160)PSA Double Amethyst: Earned 1,000,000,000 credits (1,000,000,000)
Message 130265 - Posted: 9 Jun 2019 | 0:13:58 UTC

Greetings All,

I was interested in finding out how many tasks for certain sub-projects individual computers have done, ran into some issues separating certain sub-projects, figured those out, messed around a bunch and ended up with a batch file to generate a text file summary of everything. After some initial testing within team Storm, the sub-projects from Stream's private server were also added. This has now been tested by several people on a number of computers running Windows 7 and Windows 10, and can be downloaded at the following link.

https://drive.google.com/open?id=17IyXbGtsB5tWJexuKeSH6h2XJwA-RfJa

Here is an example of the output (which should open as soon as the batch is finished):

PrimeGrid Task Summary for DESKTOP-V97EL52 Sat 06 08 2019 16:39:43.19 321 Prime Search: 0 Cullen Prime Search: 15 Extended Sierpinski Problem: 0 Generalized Cullen/Woodall: 52 Prime Sierpinski Problem: 0 Proth Prime Search: 875 Proth Prime Search Extended: 198 Proth Mega Prime Search: 0 Seventeen or Bust: 22 Sierpinski/Riesel Base 5: 172 Sophie Germain Search: 23614 The Riesel Problem: 382 Woodall Prime Search: 76 321 Sieve: 12451 GCW Sieve: 26299 PPS Sieve: 5535 GFN-13 (Stream's Server): 1028599 GFN-14 (Stream's Server): 30481 GFN-15: 216510 GFN-16: 6238 GFN-16 Mega (Stream's Server): 0 GFN-17 Low: 441 GFN-17 Mega: 11268 GFN-18: 225 GFN-19: 2 GFN-20: 3 GFN-21: 2 GFN-22: 1 GFN-DYFL: 0 AP27: 334


The sub-projects and numbers of each tasks should be in columns when viewed on Windows 10 and encapsulated by "code" tags here, but the spacing is a bit funny on Windows 7. Either way; the numbers all seem correct.

To run it; plop the .bat file into your main BOINC Data directory (not the PrimeGrid one, but the directory where you find cc_config and the other main BOINC files) and double-click. Then wait. If you have large job log files it can take some time to run. It took about a minute on the computer which produced the output above, but I have a 30MB PrimeGrid and 110MB Stream's server job log, so those are kinda big compared to what most job logs will look like. Some of you will have much larger logs than that, so it may take quite a while.

I can't guarantee that this is bug free, but it doesn't seem to have done anything bad to anyone who has run it, and it is returning the correct results for all cases where I actually know what the correct result should be. As always, only run it if you are comfortable with running stuff like this. If you find any bugs, feel free to let me know as well.

Enjoy :)

Kellen

Profile PenguinProject donor
Avatar
Send message
Joined: 14 Sep 12
Posts: 569
ID: 172547
Credit: 1,338,230,371
RAC: 2,326,963
Discovered 3 mega primesEliminated 1 conjecture "k"Discovered 1 AP26Found 1 prime in the 2019 Tour de PrimesFound 15 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,283,819)Cullen LLR Turquoise: Earned 5,000,000 credits (5,290,628)ESP LLR Jade: Earned 10,000,000 credits (10,390,853)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,370,787)PPS LLR Sapphire: Earned 20,000,000 credits (23,324,405)PSP LLR Jade: Earned 10,000,000 credits (10,475,047)SoB LLR Ruby: Earned 2,000,000 credits (2,092,713)SR5 LLR Jade: Earned 10,000,000 credits (12,638,677)SGS LLR Jade: Earned 10,000,000 credits (10,196,474)TRP LLR Turquoise: Earned 5,000,000 credits (6,845,938)Woodall LLR Turquoise: Earned 5,000,000 credits (5,152,091)321 Sieve Jade: Earned 10,000,000 credits (10,329,012)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,018,833)PPS Sieve Double Silver: Earned 200,000,000 credits (207,296,274)TRP Sieve (suspended) Silver: Earned 100,000 credits (110,630)AP 26/27 Emerald: Earned 50,000,000 credits (69,086,784)GFN Double Silver: Earned 200,000,000 credits (281,304,262)PSA Double Gold: Earned 500,000,000 credits (666,025,256)
Message 130270 - Posted: 9 Jun 2019 | 0:50:58 UTC - in response to Message 130265.
Last modified: 9 Jun 2019 | 0:57:20 UTC

Simply a fine piece of programming there. I love it!

Thank you for this Kellen!

Seeing the GFN subproject breakdown is so nice!

Kellen
Send message
Joined: 10 Jan 18
Posts: 390
ID: 967938
Credit: 1,293,461,711
RAC: 6,093
Discovered 2 mega primes321 LLR Amethyst: Earned 1,000,000 credits (1,046,831)Cullen LLR Ruby: Earned 2,000,000 credits (2,380,710)ESP LLR Ruby: Earned 2,000,000 credits (2,567,223)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,266,330)PPS LLR Turquoise: Earned 5,000,000 credits (9,917,469)PSP LLR Amethyst: Earned 1,000,000 credits (1,620,415)SoB LLR Jade: Earned 10,000,000 credits (10,953,837)SR5 LLR Ruby: Earned 2,000,000 credits (2,047,778)SGS LLR Jade: Earned 10,000,000 credits (12,255,734)TRP LLR Jade: Earned 10,000,000 credits (12,784,227)Woodall LLR Sapphire: Earned 20,000,000 credits (20,017,137)321 Sieve Sapphire: Earned 20,000,000 credits (20,000,569)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,006,424)PPS Sieve Sapphire: Earned 20,000,000 credits (42,265,598)AP 26/27 Sapphire: Earned 20,000,000 credits (39,985,270)GFN Emerald: Earned 50,000,000 credits (92,346,160)PSA Double Amethyst: Earned 1,000,000,000 credits (1,000,000,000)
Message 130271 - Posted: 9 Jun 2019 | 1:59:24 UTC - in response to Message 130270.

Thanks Penguin; glad you like it! It was the GFN subproject breakdown (specifically GFN-15) that got me thinking about this in the first place ;)

Profile Eudy SilvaProject donor
Avatar
Send message
Joined: 26 Aug 17
Posts: 1149
ID: 918937
Credit: 170,079,304
RAC: 319,890
Discovered 1 mega primeFound 2 primes in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Amethyst: Earned 1,000,000 credits (1,012,503)Cullen LLR Amethyst: Earned 1,000,000 credits (1,011,118)ESP LLR Amethyst: Earned 1,000,000 credits (1,022,307)Generalized Cullen/Woodall LLR Amethyst: Earned 1,000,000 credits (1,004,746)PPS LLR Jade: Earned 10,000,000 credits (10,912,055)PSP LLR Amethyst: Earned 1,000,000 credits (1,123,300)SoB LLR Ruby: Earned 2,000,000 credits (2,113,239)SR5 LLR Ruby: Earned 2,000,000 credits (2,947,019)SGS LLR Amethyst: Earned 1,000,000 credits (1,462,951)TRP LLR Amethyst: Earned 1,000,000 credits (1,309,179)Woodall LLR Amethyst: Earned 1,000,000 credits (1,001,901)321 Sieve Amethyst: Earned 1,000,000 credits (1,119,749)Generalized Cullen/Woodall Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,005,331)PPS Sieve Emerald: Earned 50,000,000 credits (68,687,496)AP 26/27 Sapphire: Earned 20,000,000 credits (24,326,731)GFN Sapphire: Earned 20,000,000 credits (47,960,896)PSA Ruby: Earned 2,000,000 credits (2,059,222)
Message 130272 - Posted: 9 Jun 2019 | 2:10:21 UTC

Very nice !
Thanks for sharing.

____________
"Accidit in puncto, quod non contingit in anno."
Something that does not occur in a year may, perchance, happen in a moment.

Odd-Rod
Send message
Joined: 7 Aug 06
Posts: 8
ID: 3240
Credit: 66,193,502
RAC: 147,865
321 LLR Gold: Earned 500,000 credits (595,431)Cullen LLR Gold: Earned 500,000 credits (741,852)ESP LLR Gold: Earned 500,000 credits (604,855)Generalized Cullen/Woodall LLR Gold: Earned 500,000 credits (606,540)PPS LLR Gold: Earned 500,000 credits (609,445)PSP LLR Gold: Earned 500,000 credits (965,878)SoB LLR Ruby: Earned 2,000,000 credits (2,322,181)SR5 LLR Gold: Earned 500,000 credits (697,113)SGS LLR Gold: Earned 500,000 credits (508,295)TRP LLR Gold: Earned 500,000 credits (657,015)Woodall LLR Gold: Earned 500,000 credits (812,683)321 Sieve Gold: Earned 500,000 credits (636,797)Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (60,808)Generalized Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (2,066,764)PPS Sieve Sapphire: Earned 20,000,000 credits (21,025,199)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (26,479)TRP Sieve (suspended) Silver: Earned 100,000 credits (241,181)AP 26/27 Jade: Earned 10,000,000 credits (12,146,684)GFN Sapphire: Earned 20,000,000 credits (20,865,322)
Message 130273 - Posted: 9 Jun 2019 | 9:31:11 UTC

Thanks for sharing!

____________
7063*2^460934+1 (Double checker)

Profile Michael GoetzProject donor
Honorary cruncher
Avatar
Send message
Joined: 21 Jan 10
Posts: 13240
ID: 53948
Credit: 221,845,131
RAC: 137,644
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (12,872,444)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (2,276,011)TRP LLR Ruby: Earned 2,000,000 credits (2,816,600)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,114,260)GFN Emerald: Earned 50,000,000 credits (72,383,585)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 130276 - Posted: 9 Jun 2019 | 12:48:14 UTC

Really nice.

FWIW, I made a few changes in my copy.

I changed the first two lines to be this:

echo PrimeGrid Task Summary for %computername% %Date:/= % %Time:/= % > Tasks.txt echo off


and the last two lines to be this:

type "PrimeGrid Tasks %Date:/= %.txt" echo on


That's just a matter of personal taste.

I also added a few old projects that some people may have (these probably *should* be added to your batch file):

for /f %%c in ('find /c /i "gcwsieve" ^< job_log_www.primegrid.com.txt') do set /a cwsieve=%%c echo CW Sieve: %cwsieve% >> Tasks.txt for /f %%c in ('find /c /i "psp_sr2sieve" ^< job_log_www.primegrid.com.txt') do set /a pspsieve=%%c echo PSP Sieve: %pspsieve% >> Tasks.txt for /f %%c in ('find /c /i "trp_sr2sieve" ^< job_log_www.primegrid.com.txt') do set /a trpsieve=%%c echo TRP Sieve: %trpsieve% >> Tasks.txt


It's possible someone may have some of those tasks still in the log.

Thanks for making this!
____________
My lucky number is 75898524288+1
(I am NOT an administrator anymore, so please don't PM me with questions. I can't help.)

Kellen
Send message
Joined: 10 Jan 18
Posts: 390
ID: 967938
Credit: 1,293,461,711
RAC: 6,093
Discovered 2 mega primes321 LLR Amethyst: Earned 1,000,000 credits (1,046,831)Cullen LLR Ruby: Earned 2,000,000 credits (2,380,710)ESP LLR Ruby: Earned 2,000,000 credits (2,567,223)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,266,330)PPS LLR Turquoise: Earned 5,000,000 credits (9,917,469)PSP LLR Amethyst: Earned 1,000,000 credits (1,620,415)SoB LLR Jade: Earned 10,000,000 credits (10,953,837)SR5 LLR Ruby: Earned 2,000,000 credits (2,047,778)SGS LLR Jade: Earned 10,000,000 credits (12,255,734)TRP LLR Jade: Earned 10,000,000 credits (12,784,227)Woodall LLR Sapphire: Earned 20,000,000 credits (20,017,137)321 Sieve Sapphire: Earned 20,000,000 credits (20,000,569)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,006,424)PPS Sieve Sapphire: Earned 20,000,000 credits (42,265,598)AP 26/27 Sapphire: Earned 20,000,000 credits (39,985,270)GFN Emerald: Earned 50,000,000 credits (92,346,160)PSA Double Amethyst: Earned 1,000,000,000 credits (1,000,000,000)
Message 130281 - Posted: 9 Jun 2019 | 14:08:17 UTC - in response to Message 130276.

My pleasure everyone!

Thank you for the lines Michael! I will make those changes and re-issue the file shortly. Before doing that though, just curious; is there an ESP and SoB Sieve as well, or do those tasks get counted under the PSP Sieve? If they are counted under PSP I will change the name to "ESP/PSP/SoB Sieve" to reflect the naming on the Task Status page. Otherwise I will leave it as-is.

Thanks!

Kellen

dthononProject donor
Volunteer tester
Send message
Joined: 6 Dec 17
Posts: 386
ID: 957147
Credit: 1,307,209,899
RAC: 2,989,221
Discovered 3 mega primes2018 Tour de Primes highest prime count2018 Tour de Primes highest prime scoreFound 50 primes in the 2018 Tour de PrimesFound 1 mega prime in the 2018 Tour de PrimesFound 1 prime in the 2018 Tour de Primes Mountain StageFound 1 mega prime in the 2018 Tour de Primes Mountain StageFound 5 primes in the 2019 Tour de PrimesFound 1 prime in the 2019 Tour de Primes Mountain StageFound 1 prime in the 2020 Tour de Primes321 LLR Sapphire: Earned 20,000,000 credits (40,820,847)Cullen LLR Sapphire: Earned 20,000,000 credits (20,626,660)ESP LLR Sapphire: Earned 20,000,000 credits (23,417,994)Generalized Cullen/Woodall LLR Sapphire: Earned 20,000,000 credits (25,377,013)PPS LLR Double Bronze: Earned 100,000,000 credits (163,673,527)PSP LLR Sapphire: Earned 20,000,000 credits (31,092,711)SoB LLR Double Silver: Earned 200,000,000 credits (203,308,549)SR5 LLR Sapphire: Earned 20,000,000 credits (24,613,811)SGS LLR Sapphire: Earned 20,000,000 credits (21,302,975)TRP LLR Sapphire: Earned 20,000,000 credits (30,377,063)Woodall LLR Sapphire: Earned 20,000,000 credits (20,348,047)321 Sieve Sapphire: Earned 20,000,000 credits (22,032,706)Generalized Cullen/Woodall Sieve (suspended) Double Bronze: Earned 100,000,000 credits (126,821,599)PPS Sieve Double Silver: Earned 200,000,000 credits (203,480,302)AP 26/27 Emerald: Earned 50,000,000 credits (77,702,417)GFN Double Silver: Earned 200,000,000 credits (208,186,571)PSA Emerald: Earned 50,000,000 credits (64,141,506)
Message 130289 - Posted: 9 Jun 2019 | 16:52:28 UTC - in response to Message 130281.

Similar code for Linux. It only prints the counters for tasks found in the log file. I tested it on Ubuntu and Debian, but not on CentOS/Fedora... distributions.

#!/usr/bin/env python3 import os import os.path import re from collections import Counter from datetime import datetime if os.path.exists('/var/lib/boinc-client/'): # Debian/Ubuntu/.. path path = '/var/lib/boinc-client/' elif os.path.exists('/var/lib/boinc/'): # CentOS/Fedora/... path path = '/var/lib/boinc/' else: print('BOINC path not found') raise FileNotFoundError logf1 = path + 'job_log_www.primegrid.com.txt' logf2 = path + 'job_log_boincvm.proxyma.ru_30080_test4vm.txt' cnt = Counter() p = re.compile(r'(\w*)_\d*_\d*') nb_lines = 0 def count(logf): global nb_lines # Read lines from log file try: with open(logf) as f: for line in f: nb_lines += 1 # Split by whitespace and take 9th item task = line.split()[8] # Pattern match for application name app = p.match(task).group(1) #print('{} -> {}'.format(task, app)) # Update counter cnt.update([app]) except FileNotFoundError: print('File {} not found'.format(logf)) return None count(logf1) count(logf2) print('PrimeGrid Task Summary for {}, at {}'.format(os.uname()[1], datetime.now())) print('Total tasks = {} | Lines in log file = {}'.format(sum(cnt.values()), nb_lines)) for (k, v) in sorted(cnt.items()): print('{0:15s}: {1:8d}'.format(k, v))

Profile Michael GoetzProject donor
Honorary cruncher
Avatar
Send message
Joined: 21 Jan 10
Posts: 13240
ID: 53948
Credit: 221,845,131
RAC: 137,644
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de PrimesFound 1 prime in the 2020 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (12,872,444)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,291,181)SR5 LLR Jade: Earned 10,000,000 credits (10,007,110)SGS LLR Ruby: Earned 2,000,000 credits (2,276,011)TRP LLR Ruby: Earned 2,000,000 credits (2,816,600)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Jade: Earned 10,000,000 credits (10,061,196)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (22,885,121)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,114,260)GFN Emerald: Earned 50,000,000 credits (72,383,585)PSA Jade: Earned 10,000,000 credits (12,445,029)
Message 130290 - Posted: 9 Jun 2019 | 17:12:05 UTC - in response to Message 130281.

My pleasure everyone!

Thank you for the lines Michael! I will make those changes and re-issue the file shortly. Before doing that though, just curious; is there an ESP and SoB Sieve as well, or do those tasks get counted under the PSP Sieve? If they are counted under PSP I will change the name to "ESP/PSP/SoB Sieve" to reflect the naming on the Task Status page. Otherwise I will leave it as-is.

Thanks!

Kellen


ESP/PSP/SOB were all the same sieve project.
____________
My lucky number is 75898524288+1
(I am NOT an administrator anymore, so please don't PM me with questions. I can't help.)

Kellen
Send message
Joined: 10 Jan 18
Posts: 390
ID: 967938
Credit: 1,293,461,711
RAC: 6,093
Discovered 2 mega primes321 LLR Amethyst: Earned 1,000,000 credits (1,046,831)Cullen LLR Ruby: Earned 2,000,000 credits (2,380,710)ESP LLR Ruby: Earned 2,000,000 credits (2,567,223)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (3,266,330)PPS LLR Turquoise: Earned 5,000,000 credits (9,917,469)PSP LLR Amethyst: Earned 1,000,000 credits (1,620,415)SoB LLR Jade: Earned 10,000,000 credits (10,953,837)SR5 LLR Ruby: Earned 2,000,000 credits (2,047,778)SGS LLR Jade: Earned 10,000,000 credits (12,255,734)TRP LLR Jade: Earned 10,000,000 credits (12,784,227)Woodall LLR Sapphire: Earned 20,000,000 credits (20,017,137)321 Sieve Sapphire: Earned 20,000,000 credits (20,000,569)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,006,424)PPS Sieve Sapphire: Earned 20,000,000 credits (42,265,598)AP 26/27 Sapphire: Earned 20,000,000 credits (39,985,270)GFN Emerald: Earned 50,000,000 credits (92,346,160)PSA Double Amethyst: Earned 1,000,000,000 credits (1,000,000,000)
Message 130293 - Posted: 9 Jun 2019 | 17:44:14 UTC - in response to Message 130290.

Thanks!

It has now been updated and I ended up with two versions based on different user preferences (and probably different job log file sizes). My job logs are pretty big and it takes a while to run through everything, so with echo off I was prone to thinking that something broke, but I can definitely see how having echo off would be desirable in many cases, so I made two :)

For the version that runs the same way the original did (ie. shows everything in the command window, then opens the file at the end) the link is here;

https://drive.google.com/open?id=1bHaAa_pfiwiftTTvlkxpKi8gglGbRK_y

For the version that runs a little "quieter" and doesn't pop the file open in the end, the link is here;

https://drive.google.com/open?id=17Lv2CwFhqjrWJzS3IADD1MZzS2uOd9Zv

Both now include the older sieves that I was missing. Thanks again Michael!

darkclownProject donor
Send message
Joined: 3 Oct 06
Posts: 279
ID: 3605
Credit: 664,565,524
RAC: 637,072
Discovered 2 mega primesFound 2 primes in the 2020 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (10,750,090)Cullen LLR Turquoise: Earned 5,000,000 credits (5,787,581)ESP LLR Turquoise: Earned 5,000,000 credits (5,332,324)Generalized Cullen/Woodall LLR Turquoise: Earned 5,000,000 credits (5,506,675)PPS LLR Sapphire: Earned 20,000,000 credits (24,024,368)PSP LLR Jade: Earned 10,000,000 credits (10,923,081)SoB LLR Jade: Earned 10,000,000 credits (11,298,174)SR5 LLR Sapphire: Earned 20,000,000 credits (20,212,405)SGS LLR Jade: Earned 10,000,000 credits (10,101,262)TPS LLR (retired) Bronze: Earned 10,000 credits (14,608)TRP LLR Turquoise: Earned 5,000,000 credits (6,668,777)Woodall LLR Jade: Earned 10,000,000 credits (10,123,533)321 Sieve Sapphire: Earned 20,000,000 credits (25,014,763)Generalized Cullen/Woodall Sieve (suspended) Jade: Earned 10,000,000 credits (10,370,445)PPS Sieve Double Bronze: Earned 100,000,000 credits (108,319,032)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Gold: Earned 500,000 credits (718,547)TRP Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,027,562)AP 26/27 Double Bronze: Earned 100,000,000 credits (100,324,877)GFN Emerald: Earned 50,000,000 credits (76,751,851)PSA Double Silver: Earned 200,000,000 credits (221,292,409)
Message 130306 - Posted: 10 Jun 2019 | 4:36:36 UTC

Awesome little script! Thanks Kellen!
____________
My lucky #: 60133106^131072+1 (GFN 17-mega)

Profile composite
Volunteer tester
Send message
Joined: 16 Feb 10
Posts: 750
ID: 55391
Credit: 656,539,676
RAC: 404,840
Discovered 2 mega primesFound 1 prime in the 2018 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,477,467)Cullen LLR Gold: Earned 500,000 credits (776,297)ESP LLR Ruby: Earned 2,000,000 credits (3,120,351)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,056,207)PPS LLR Jade: Earned 10,000,000 credits (16,510,522)PSP LLR Turquoise: Earned 5,000,000 credits (5,027,818)SoB LLR Sapphire: Earned 20,000,000 credits (22,881,591)SR5 LLR Turquoise: Earned 5,000,000 credits (6,110,877)SGS LLR Ruby: Earned 2,000,000 credits (3,477,744)TRP LLR Turquoise: Earned 5,000,000 credits (7,025,303)Woodall LLR Amethyst: Earned 1,000,000 credits (1,693,614)321 Sieve Sapphire: Earned 20,000,000 credits (37,574,101)Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,571,178)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (50,009,610)PPS Sieve Double Silver: Earned 200,000,000 credits (296,864,365)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Jade: Earned 10,000,000 credits (10,165,888)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,071,454)AP 26/27 Turquoise: Earned 5,000,000 credits (6,616,128)GFN Emerald: Earned 50,000,000 credits (52,755,348)PSA Double Bronze: Earned 100,000,000 credits (102,762,384)
Message 130310 - Posted: 10 Jun 2019 | 6:25:54 UTC
Last modified: 10 Jun 2019 | 6:30:34 UTC

The spirit of shell usage in Linux is to reuse existing tools and write little new software.
This bash two-liner will work on any flavour of Linux.
You'll notice that I threw in plenty of unnecessary spaces for readability.

echo PrimeGrid Task Summary for $(uname -n), at $(date); cut -d ' ' -f 9 /var/lib/boinc*/job_log_www.primegrid.com.txt | sed 's/_[0-9].*//' | perl -e 'chomp(@a=<>); $cnt{$_}++ for @a; printf "%-15s%8d\n", $_, $cnt{$_} for sort keys %cnt;'

whynot
Send message
Joined: 9 Mar 11
Posts: 126
ID: 89957
Credit: 37,958,580
RAC: 30,664
321 LLR Gold: Earned 500,000 credits (587,721)Cullen LLR Silver: Earned 100,000 credits (434,353)ESP LLR Silver: Earned 100,000 credits (228,370)Generalized Cullen/Woodall LLR Silver: Earned 100,000 credits (133,139)PPS LLR Gold: Earned 500,000 credits (746,530)PSP LLR Gold: Earned 500,000 credits (951,723)SoB LLR Sapphire: Earned 20,000,000 credits (30,933,209)SR5 LLR Silver: Earned 100,000 credits (221,631)SGS LLR Bronze: Earned 10,000 credits (58,225)TRP LLR Gold: Earned 500,000 credits (542,327)Woodall LLR Gold: Earned 500,000 credits (783,073)Generalized Cullen/Woodall Sieve (suspended) Silver: Earned 100,000 credits (120,713)PPS Sieve Gold: Earned 500,000 credits (636,552)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Silver: Earned 100,000 credits (102,989)TRP Sieve (suspended) Silver: Earned 100,000 credits (139,663)AP 26/27 Silver: Earned 100,000 credits (165,763)GFN Amethyst: Earned 1,000,000 credits (1,170,976)
Message 130425 - Posted: 15 Jun 2019 | 16:46:45 UTC - in response to Message 130310.

The spirit of shell usage in Linux is to reuse existing tools and write little new software.
This bash two-liner will work on any flavour of Linux.
You'll notice that I threw in plenty of unnecessary spaces for readability.

echo PrimeGrid Task Summary for $(uname -n), at $(date); cut -d ' ' -f 9 /var/lib/boinc*/job_log_www.primegrid.com.txt | sed 's/_[0-9].*//' | perl -e 'chomp(@a=<>); $cnt{$_}++ for @a; printf "%-15s%8d\n", $_, $cnt{$_} for sort keys %cnt;'


That's what always puzzled me about bash-types. If you are sliding to perl anyway, why would you keep cut, sed, and whatnot. Do it with perl!

perl -nle ' $aa=(split / /)[8]; $aa=~s{_[0-9Me._]+$}{}; $ab{$aa}++; END { printf "%-16s%8d\n", $_, $ab{$_} foreach sort keys %ab }' \ /var/lib/boinc*/job_log_www.primegrid.com.txt


Yes, it can be made shorter but that's not the point. Yes, you can do multiline quoted strings, even with bash. Also, '[0-9Me._]' bears 'M', 'e', and '.' for a reason.

p.s. Also, worth noting. You don't need perl for this. Modern shells, even bash, provide associative arrays and printf for eternity.

____________
I'm counting for science,
Points just make me sick.

Profile composite
Volunteer tester
Send message
Joined: 16 Feb 10
Posts: 750
ID: 55391
Credit: 656,539,676
RAC: 404,840
Discovered 2 mega primesFound 1 prime in the 2018 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,477,467)Cullen LLR Gold: Earned 500,000 credits (776,297)ESP LLR Ruby: Earned 2,000,000 credits (3,120,351)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,056,207)PPS LLR Jade: Earned 10,000,000 credits (16,510,522)PSP LLR Turquoise: Earned 5,000,000 credits (5,027,818)SoB LLR Sapphire: Earned 20,000,000 credits (22,881,591)SR5 LLR Turquoise: Earned 5,000,000 credits (6,110,877)SGS LLR Ruby: Earned 2,000,000 credits (3,477,744)TRP LLR Turquoise: Earned 5,000,000 credits (7,025,303)Woodall LLR Amethyst: Earned 1,000,000 credits (1,693,614)321 Sieve Sapphire: Earned 20,000,000 credits (37,574,101)Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,571,178)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (50,009,610)PPS Sieve Double Silver: Earned 200,000,000 credits (296,864,365)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Jade: Earned 10,000,000 credits (10,165,888)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,071,454)AP 26/27 Turquoise: Earned 5,000,000 credits (6,616,128)GFN Emerald: Earned 50,000,000 credits (52,755,348)PSA Double Bronze: Earned 100,000,000 credits (102,762,384)
Message 130456 - Posted: 17 Jun 2019 | 11:52:58 UTC - in response to Message 130425.

The spirit of shell usage in Linux is to reuse existing tools and write little new software.
This bash two-liner will work on any flavour of Linux.
You'll notice that I threw in plenty of unnecessary spaces for readability.

echo PrimeGrid Task Summary for $(uname -n), at $(date); cut -d ' ' -f 9 /var/lib/boinc*/job_log_www.primegrid.com.txt | sed 's/_[0-9].*//' | perl -e 'chomp(@a=<>); $cnt{$_}++ for @a; printf "%-15s%8d\n", $_, $cnt{$_} for sort keys %cnt;'


That's what always puzzled me about bash-types. If you are sliding to perl anyway, why would you keep cut, sed, and whatnot. Do it with perl!

perl -nle ' $aa=(split / /)[8]; $aa=~s{_[0-9Me._]+$}{}; $ab{$aa}++; END { printf "%-16s%8d\n", $_, $ab{$_} foreach sort keys %ab }' \ /var/lib/boinc*/job_log_www.primegrid.com.txt


Yes, it can be made shorter but that's not the point. Yes, you can do multiline quoted strings, even with bash. Also, '[0-9Me._]' bears 'M', 'e', and '.' for a reason.

p.s. Also, worth noting. You don't need perl for this. Modern shells, even bash, provide associative arrays and printf for eternity.

That's the ticket. I've never used an END block so I didn't see how to get the summary from perl with -nle.

Message boards : Number crunching : PrimeGrid Task Summary Generator

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2020 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 1.65, 1.51, 1.64
Generated 6 Jul 2020 | 6:00:29 UTC