PrimeGrid
Please visit donation page to help the project cover running costs for this month

Toggle Menu

Join PrimeGrid

Returning Participants

Community

Leader Boards

Results

Other

drummers-lowrise

Advanced search

Message boards : Number crunching : New feature question?

Author Message
Chaotic DisorderProject donor
Avatar
Send message
Joined: 24 Sep 10
Posts: 75
ID: 68547
Credit: 274,305,432
RAC: 683,988
Discovered 1 mega primeFound 1 prime in the 2018 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (12,513,629)Cullen LLR Gold: Earned 500,000 credits (588,204)ESP LLR Ruby: Earned 2,000,000 credits (3,650,366)Generalized Cullen/Woodall LLR Gold: Earned 500,000 credits (765,031)PPS LLR Turquoise: Earned 5,000,000 credits (9,386,917)PSP LLR Amethyst: Earned 1,000,000 credits (1,881,456)SoB LLR Turquoise: Earned 5,000,000 credits (5,571,796)SR5 LLR Ruby: Earned 2,000,000 credits (2,940,238)SGS LLR Amethyst: Earned 1,000,000 credits (1,960,946)TRP LLR Amethyst: Earned 1,000,000 credits (1,182,488)Woodall LLR Gold: Earned 500,000 credits (719,170)321 Sieve Silver: Earned 100,000 credits (499,544)Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (26,059)Generalized Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (3,566,529)PPS Sieve Emerald: Earned 50,000,000 credits (69,048,665)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (25,179)TRP Sieve (suspended) Silver: Earned 100,000 credits (260,129)AP 26/27 Double Bronze: Earned 100,000,000 credits (101,083,086)GFN Emerald: Earned 50,000,000 credits (58,642,549)
Message 115207 - Posted: 19 Feb 2018 | 0:50:35 UTC

Would it be a pain to add a feature of being able to sort the results page? Then we could sort by time the task was received or runtimes or all the 1st completed ones and so on. If so it's not a big deal, but I think it would be nice.

Thanks
____________

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Project scientist
Avatar
Send message
Joined: 21 Jan 10
Posts: 13116
ID: 53948
Credit: 208,910,513
RAC: 131,227
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (10,595,835)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,221,148)SR5 LLR Turquoise: Earned 5,000,000 credits (8,927,128)SGS LLR Ruby: Earned 2,000,000 credits (2,014,138)TRP LLR Ruby: Earned 2,000,000 credits (2,737,347)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Turquoise: Earned 5,000,000 credits (7,128,259)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (20,110,788)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,114,260)GFN Emerald: Earned 50,000,000 credits (68,965,890)PSA Jade: Earned 10,000,000 credits (12,404,447)
Message 115211 - Posted: 19 Feb 2018 | 2:00:27 UTC - in response to Message 115207.

Would it be a pain to add a feature of being able to sort the results page? Then we could sort by time the task was received or runtimes or all the 1st completed ones and so on. If so it's not a big deal, but I think it would be nice.

Thanks


Sorting a table is trivial; it's a simple java script that executes in the browser. The TdP leaderboard page is an example of that. The tricky part here is sorting a table that spans multiple pages -- that has to be done at the server, and it requires retrieving the results from the database in the desired order. That, in turn, requires some fancy DBA-fu because we've got users with tens of thousands af results, and the results table is the largest table in the database. I could easily do it if you don't mind if I bring the entire server to its knees. Assuming we don't want the server grinding to a halt every time Scott looks at his tasks, something like this requires a lot of effort.

It was a significant undertaking just to add the task counters to the results page (for those of you who remember back that far).

To put it another way, if it was easy to do, I would have already done it. That being said, it's something I'd like to have too, so it may happen some day.
____________
Please do not PM me with support questions. Ask on the forums instead. Thank you!

My lucky number is 75898524288+1

Chaotic DisorderProject donor
Avatar
Send message
Joined: 24 Sep 10
Posts: 75
ID: 68547
Credit: 274,305,432
RAC: 683,988
Discovered 1 mega primeFound 1 prime in the 2018 Tour de Primes321 LLR Jade: Earned 10,000,000 credits (12,513,629)Cullen LLR Gold: Earned 500,000 credits (588,204)ESP LLR Ruby: Earned 2,000,000 credits (3,650,366)Generalized Cullen/Woodall LLR Gold: Earned 500,000 credits (765,031)PPS LLR Turquoise: Earned 5,000,000 credits (9,386,917)PSP LLR Amethyst: Earned 1,000,000 credits (1,881,456)SoB LLR Turquoise: Earned 5,000,000 credits (5,571,796)SR5 LLR Ruby: Earned 2,000,000 credits (2,940,238)SGS LLR Amethyst: Earned 1,000,000 credits (1,960,946)TRP LLR Amethyst: Earned 1,000,000 credits (1,182,488)Woodall LLR Gold: Earned 500,000 credits (719,170)321 Sieve Silver: Earned 100,000 credits (499,544)Cullen/Woodall Sieve (suspended) Bronze: Earned 10,000 credits (26,059)Generalized Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (3,566,529)PPS Sieve Emerald: Earned 50,000,000 credits (69,048,665)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Bronze: Earned 10,000 credits (25,179)TRP Sieve (suspended) Silver: Earned 100,000 credits (260,129)AP 26/27 Double Bronze: Earned 100,000,000 credits (101,083,086)GFN Emerald: Earned 50,000,000 credits (58,642,549)
Message 115214 - Posted: 19 Feb 2018 | 2:06:42 UTC - in response to Message 115211.

I understand, I didn't consider the problem of having to do it with thousands of tasks and the processing power that would take.
____________

Profile mikey
Avatar
Send message
Joined: 17 Mar 09
Posts: 1040
ID: 37043
Credit: 463,804,910
RAC: 31,990
Discovered 1 mega prime321 LLR Amethyst: Earned 1,000,000 credits (1,071,031)Cullen LLR Amethyst: Earned 1,000,000 credits (1,165,737)ESP LLR Amethyst: Earned 1,000,000 credits (1,021,868)Generalized Cullen/Woodall LLR Amethyst: Earned 1,000,000 credits (1,046,510)PPS LLR Turquoise: Earned 5,000,000 credits (5,090,575)PSP LLR Amethyst: Earned 1,000,000 credits (1,291,823)SoB LLR Amethyst: Earned 1,000,000 credits (1,043,824)SR5 LLR Amethyst: Earned 1,000,000 credits (1,000,984)SGS LLR Turquoise: Earned 5,000,000 credits (5,095,282)TRP LLR Amethyst: Earned 1,000,000 credits (1,033,808)Woodall LLR Amethyst: Earned 1,000,000 credits (1,088,488)321 Sieve Ruby: Earned 2,000,000 credits (2,357,609)Cullen/Woodall Sieve (suspended) Gold: Earned 500,000 credits (944,431)Generalized Cullen/Woodall Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,813,253)PPS Sieve Double Silver: Earned 200,000,000 credits (337,602,360)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Ruby: Earned 2,000,000 credits (2,446,797)AP 26/27 Sapphire: Earned 20,000,000 credits (33,132,385)GFN Sapphire: Earned 20,000,000 credits (26,107,141)PSA Sapphire: Earned 20,000,000 credits (20,457,430)
Message 115233 - Posted: 19 Feb 2018 | 11:31:45 UTC

Michael Goetz could you export the stats to the new servers you guys have and then do all the sorting stuff on them, bypassing the main servers for the tough stuff, then displaying it for us users? Some configuration stuff for sure but server to server transfers should be quick. Maybe you could try it for some tasks to see if it does work and frees up the main Servers. Of course I'm thinking like a guy with multiple pc's not a set of computers needed to run a Boinc Project.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Project scientist
Avatar
Send message
Joined: 21 Jan 10
Posts: 13116
ID: 53948
Credit: 208,910,513
RAC: 131,227
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (10,595,835)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,221,148)SR5 LLR Turquoise: Earned 5,000,000 credits (8,927,128)SGS LLR Ruby: Earned 2,000,000 credits (2,014,138)TRP LLR Ruby: Earned 2,000,000 credits (2,737,347)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Turquoise: Earned 5,000,000 credits (7,128,259)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (20,110,788)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,114,260)GFN Emerald: Earned 50,000,000 credits (68,965,890)PSA Jade: Earned 10,000,000 credits (12,404,447)
Message 115240 - Posted: 19 Feb 2018 | 12:32:51 UTC - in response to Message 115233.

Michael Goetz could you export the stats to the new servers you guys have and then do all the sorting stuff on them, bypassing the main servers for the tough stuff, then displaying it for us users? Some configuration stuff for sure but server to server transfers should be quick. Maybe you could try it for some tasks to see if it does work and frees up the main Servers. Of course I'm thinking like a guy with multiple pc's not a set of computers needed to run a Boinc Project.


No.
____________
Please do not PM me with support questions. Ask on the forums instead. Thank you!

My lucky number is 75898524288+1

Profile composite
Volunteer tester
Send message
Joined: 16 Feb 10
Posts: 734
ID: 55391
Credit: 597,138,348
RAC: 557,575
Discovered 2 mega primesFound 1 prime in the 2018 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,477,467)Cullen LLR Gold: Earned 500,000 credits (776,297)ESP LLR Ruby: Earned 2,000,000 credits (3,120,351)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,056,207)PPS LLR Jade: Earned 10,000,000 credits (13,288,664)PSP LLR Turquoise: Earned 5,000,000 credits (5,027,818)SoB LLR Sapphire: Earned 20,000,000 credits (20,302,727)SR5 LLR Turquoise: Earned 5,000,000 credits (5,978,312)SGS LLR Ruby: Earned 2,000,000 credits (2,940,587)TRP LLR Turquoise: Earned 5,000,000 credits (7,025,303)Woodall LLR Amethyst: Earned 1,000,000 credits (1,693,614)321 Sieve Sapphire: Earned 20,000,000 credits (26,021,050)Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,571,178)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (50,009,610)PPS Sieve Double Silver: Earned 200,000,000 credits (256,628,109)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Jade: Earned 10,000,000 credits (10,165,888)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,071,454)AP 26/27 Turquoise: Earned 5,000,000 credits (6,616,128)GFN Emerald: Earned 50,000,000 credits (51,614,061)PSA Double Bronze: Earned 100,000,000 credits (102,762,384)
Message 115241 - Posted: 19 Feb 2018 | 12:37:49 UTC

While on the topic of new features, about this one:

Each complete and validated tasks shows it's percentile runtime among that subproject. The feature is only useful if you have crunched a task in that subproject. It should be displayed by task rather than by host because configurations can change.

The sample of tasks for the reference list for computing percentiles can be the last 1000 tasks (or whatever), taken periodically (15 minutes, hourly, daily, whatever makes sense) and saved in a separate table for the percentile computations.

What users will see on the tasks list is a metric that changes over time as the reference list is updated and the mix of computers working on that subproject changes. To limit computational overhead, this feature could be only shown on the "tasks by host" page. Also there is available real estate on this page for another column because there is no host column.

Effectively this feature would give a "market signal" telling users when it would be "more profitable" for them to run tasks in that subproject. Given that most users are laying real money on the line to pay the power bill, it makes sense to give this kind of feedback.

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Project scientist
Avatar
Send message
Joined: 21 Jan 10
Posts: 13116
ID: 53948
Credit: 208,910,513
RAC: 131,227
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (10,595,835)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,221,148)SR5 LLR Turquoise: Earned 5,000,000 credits (8,927,128)SGS LLR Ruby: Earned 2,000,000 credits (2,014,138)TRP LLR Ruby: Earned 2,000,000 credits (2,737,347)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Turquoise: Earned 5,000,000 credits (7,128,259)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (20,110,788)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,114,260)GFN Emerald: Earned 50,000,000 credits (68,965,890)PSA Jade: Earned 10,000,000 credits (12,404,447)
Message 115242 - Posted: 19 Feb 2018 | 12:40:10 UTC - in response to Message 115241.

While on the topic of new features, about this one:

Each complete and validated tasks shows it's percentile runtime among that subproject. The feature is only useful if you have crunched a task in that subproject. It should be displayed by task rather than by host because configurations can change.

The sample of tasks for the reference list for computing percentiles can be the last 1000 tasks (or whatever), taken periodically (15 minutes, hourly, daily, whatever makes sense) and saved in a separate table for the percentile computations.

What users will see on the tasks list is a metric that changes over time as the reference list is updated and the mix of computers working on that subproject changes. To limit computational overhead, this feature could be only shown on the "tasks by host" page. Also there is available real estate on this page for another column because there is no host column.

Effectively this feature would give a "market signal" telling users when it would be "more profitable" for them to run tasks in that subproject. Given that most users are laying real money on the line to pay the power bill, it makes sense to give this kind of feedback.


No.


____________
Please do not PM me with support questions. Ask on the forums instead. Thank you!

My lucky number is 75898524288+1

Profile Michael GoetzProject donor
Volunteer moderator
Project administrator
Project scientist
Avatar
Send message
Joined: 21 Jan 10
Posts: 13116
ID: 53948
Credit: 208,910,513
RAC: 131,227
The "Shut up already!" badge:  This loud mouth has mansplained on the forums over 10 thousand times!  Sheesh!!!Discovered the World's First GFN-19 prime!!!Discovered 1 mega primeFound 1 prime in the 2018 Tour de PrimesFound 1 prime in the 2019 Tour de Primes321 LLR Ruby: Earned 2,000,000 credits (2,822,730)Cullen LLR Ruby: Earned 2,000,000 credits (2,005,249)ESP LLR Turquoise: Earned 5,000,000 credits (5,009,577)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,145,754)PPS LLR Jade: Earned 10,000,000 credits (10,595,835)PSP LLR Turquoise: Earned 5,000,000 credits (5,197,957)SoB LLR Sapphire: Earned 20,000,000 credits (34,221,148)SR5 LLR Turquoise: Earned 5,000,000 credits (8,927,128)SGS LLR Ruby: Earned 2,000,000 credits (2,014,138)TRP LLR Ruby: Earned 2,000,000 credits (2,737,347)Woodall LLR Ruby: Earned 2,000,000 credits (2,195,123)321 Sieve Turquoise: Earned 5,000,000 credits (7,128,259)Cullen/Woodall Sieve (suspended) Ruby: Earned 2,000,000 credits (4,170,256)Generalized Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,059,304)PPS Sieve Sapphire: Earned 20,000,000 credits (20,110,788)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Amethyst: Earned 1,000,000 credits (1,035,522)TRP Sieve (suspended) Ruby: Earned 2,000,000 credits (2,051,121)AP 26/27 Jade: Earned 10,000,000 credits (10,114,260)GFN Emerald: Earned 50,000,000 credits (68,965,890)PSA Jade: Earned 10,000,000 credits (12,404,447)
Message 115243 - Posted: 19 Feb 2018 | 12:43:51 UTC

I don't mind new suggestions. Sometimes you'll give me incentive to do something I already was already considering. Sometimes it will be something truly new and inspirational.

And sometimes it won't. There's not always going to be an explanation.
____________
Please do not PM me with support questions. Ask on the forums instead. Thank you!

My lucky number is 75898524288+1

Profile composite
Volunteer tester
Send message
Joined: 16 Feb 10
Posts: 734
ID: 55391
Credit: 597,138,348
RAC: 557,575
Discovered 2 mega primesFound 1 prime in the 2018 Tour de Primes321 LLR Turquoise: Earned 5,000,000 credits (5,477,467)Cullen LLR Gold: Earned 500,000 credits (776,297)ESP LLR Ruby: Earned 2,000,000 credits (3,120,351)Generalized Cullen/Woodall LLR Ruby: Earned 2,000,000 credits (2,056,207)PPS LLR Jade: Earned 10,000,000 credits (13,288,664)PSP LLR Turquoise: Earned 5,000,000 credits (5,027,818)SoB LLR Sapphire: Earned 20,000,000 credits (20,302,727)SR5 LLR Turquoise: Earned 5,000,000 credits (5,978,312)SGS LLR Ruby: Earned 2,000,000 credits (2,940,587)TRP LLR Turquoise: Earned 5,000,000 credits (7,025,303)Woodall LLR Amethyst: Earned 1,000,000 credits (1,693,614)321 Sieve Sapphire: Earned 20,000,000 credits (26,021,050)Cullen/Woodall Sieve (suspended) Turquoise: Earned 5,000,000 credits (5,571,178)Generalized Cullen/Woodall Sieve (suspended) Emerald: Earned 50,000,000 credits (50,009,610)PPS Sieve Double Silver: Earned 200,000,000 credits (256,628,109)Sierpinski (ESP/PSP/SoB) Sieve (suspended) Jade: Earned 10,000,000 credits (10,165,888)TRP Sieve (suspended) Sapphire: Earned 20,000,000 credits (20,071,454)AP 26/27 Turquoise: Earned 5,000,000 credits (6,616,128)GFN Emerald: Earned 50,000,000 credits (51,614,061)PSA Double Bronze: Earned 100,000,000 credits (102,762,384)
Message 115244 - Posted: 19 Feb 2018 | 12:50:07 UTC

OK, then I won't be discouraged by my low proposal acceptance rate.
You are probably overworked and need more help.

Message boards : Number crunching : New feature question?

[Return to PrimeGrid main page]
DNS Powered by DNSEXIT.COM
Copyright © 2005 - 2020 Rytis Slatkevičius (contact) and PrimeGrid community. Server load 1.43, 1.73, 2.05
Generated 26 Jan 2020 | 12:23:49 UTC