Join PrimeGrid
Returning Participants
Community
Leader Boards
Results
Other
drummers-lowrise
|
Message boards :
Number crunching :
Is there a problem with the location specific PrimeGrid Preferences pages??
| Author |
Message |
|
|
|
About a year ago, I had assigned something between Pluto...Sun to my ~10 hosts, based on their hardware, and carefully selected what subprojects on which hardware (CPU vs GPU) to run on each location. And, it worked. And, seems to continue to work. But, on a whim, I just wanted to check the PrimeGrid Preferences for my Sun location, and all I can see is that "Generalized Cullen/Woodall Sieve (GCW-Sieve)" is turned on for CPU, and everything else is off, including "Send work from any subproject if selected projects have no work" which I had set to ON for every location. Huh? That location is used for a specific host that gives exclusive access to PrimeGrid to its dual Titan Z cards among all BOINC projects running on it, and was exclusively reserved for GFN-22 NVidia OpenCL. But, even though the pref page (http://www.primegrid.com/add_venue.php?venue=Sun&subset=project&tnow=1492195367&ttok=243c4f0564204af2ea9fba3eaf8a001e) seems to not show that anymore, looking at the history of that only host in that location (http://www.primegrid.com/show_host_detail.php?hostid=505815) still shows up as running the most GFN-22 tasks (27 out of 34) (http://www.primegrid.com/results.php?hostid=505815&offset=0&show_names=0&state=0&appid=17) than any other host I have (http://www.primegrid.com/results.php?userid=388469&offset=0&show_names=0&state=0&appid=17).
So, it seems like the machines are still in the locations I assigned them to, and are still receiving the sets of tasks I want them to, but the location settings pages are not reflecting that anymore.
I checked all my hosts and PrimeGrid location preferences, and I am seeing the same issue. The location based settings pages all show the same for all locations with just that one subproject turned on, instead of my carefully tuned settings, yet the hosts seem to be receiving proper tasks.
Is there a bug somewhere? Or, am I missing something?
Thanks
Tuna
PS: In the off chance that this is related: A few weeks ago I changed the priority of PG from 100 to 200 in BOINC Account Manager site, which properly communicated with PG to set it to 200 in the non-location PG settings. I wonder if that broke some sort of a connection between the location vs. non-location settings in my PG account for display-only purposes.
____________
| |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
|
Hello Tuna. It's nice to hear from you again.
Looking at your preferences, you seem to have no venues defined other than the default venue. No "home", no "sun". Nothing.
I can't speak as to what may have caused this. It's not something I've ever seen before. Can you reproduce the circumstances that caused the locations to be deleted? Any idea at all what might have occurred when this happened? Any clue as to when it may have happened?
I realize that's not much help, but there's not much I can see other than the fact that you don't currently have any locations other the the default location.
With your hosts set to specific locations which as of now don't exist, it's a certainty they're not going to get the tasks you intended.
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
|
I have a hunch. It's a long shot, though.
This computer was set to get GPU tasks for GFN22. Do you remember if it was also set up to get CPU tasks for GFN22?
I ask because a month or two ago we deprecated the CPU version of the GFN22 app, rendering that setting irrelevant. There's no reason to expect this to cause problems, but it's the only thing unusual that's happened recently.
____________
My lucky number is 75898524288+1 | |
|
|
|
PS: In the off chance that this is related: A few weeks ago I changed the priority of PG from 100 to 200 in BOINC Account Manager site, which properly communicated with PG to set it to 200 in the non-location PG settings. I wonder if that broke some sort of a connection between the location vs. non-location settings in my PG account for display-only purposes.
Pretty sure that's what did it. I did that with BOINC Stats for a couple projects on different hosts and while it did change the resource settings, it also reset everything else at the project site to the defaults.
Edit: to clarify it reset per host. The ones I didn't change the resource settings on were unaffected. | |
|
|
|
Hello Tuna. It's nice to hear from you again.
Same here! Travels & surgeries & recovery kept me away, while the PCs kept churning...
Looking at your preferences, you seem to have no venues defined other than the default venue. No "home", no "sun". Nothing.
Oh, my!!! Can you see in the database when the last time a location was deleted under my account?
I can't speak as to what may have caused this. It's not something I've ever seen before. Can you reproduce the circumstances that caused the locations to be deleted? Any idea at all what might have occurred when this happened? Any clue as to when it may have happened?
No idea how to repro it, since they are all gone now. :(
As for ideas, look at my PS section in my post. That change of Priority from 100 to 200 happened about two weeks ago. I wonder if when BAM asked PG to make that change, PG decided to make the change and delete all locations.
With your hosts set to specific locations which as of now don't exist, it's a certainty they're not going to get the tasks you intended.
Dangit! And, I don't think I kept any records from a year ago as to what each location was doing... Even if I wrote it down somewhere, wouldn't know where it is right now. No way you can retrieve from any old records, right? I am sure deleted rows keep getting purged from the db.
| |
|
|
|
This computer was set to get GPU tasks for GFN22. Do you remember if it was also set up to get CPU tasks for GFN22?
I ask because a month or two ago we deprecated the CPU version of the GFN22 app, rendering that setting irrelevant. There's no reason to expect this to cause problems, but it's the only thing unusual that's happened recently.
Yeah, I saw that post...
I used to have both CPU & GPU, and dedicated the whole machine to GFN-22 with its 8 cores, but then realized that the CPU wasn't worth it, so had it removed and given to other projects as a CPU-only host, and allowed only PG to use the GPU.
Tuna
____________
| |
|
|
|
PS: In the off chance that this is related: A few weeks ago I changed the priority of PG from 100 to 200 in BOINC Account Manager site, which properly communicated with PG to set it to 200 in the non-location PG settings. I wonder if that broke some sort of a connection between the location vs. non-location settings in my PG account for display-only purposes.
Pretty sure that's what did it. I did that with BOINC Stats for a couple projects on different hosts and while it did change the resource settings, it also reset everything else at the project site to the defaults.
Oh, dear goodness... That sucks! Majorly... I had changed the priority of pretty much all ~50 projects. Seems I need to go into each project and verify the default settings. I think PG was the only one I used location-based preferences for. Everywhere else, all my hosts are in the default zone, but even in that default zone I have things like "use all CPUs/GPUs + run test projects + run all projects + whatever"... Gotta check'em all now... :(
Gotta let Willy@BS know about this.
Tuna
| |
|
|
|
Edit: to clarify it reset per host. The ones I didn't change the resource settings on were unaffected.
To make sure:
Did you change the values in https://boincstats.com/en/bam/projects/, which would have changed it at the project site at the project level, thus for all hosts attached to the changed project? And, in the process, you say it reset the rest of the default location settings at the project level?
Or, you changed the values by going into one of your hosts on https://boincstats.com/en/bam/hosts/ and click Edit Projects and then change defaults for a few projects in that page, hoping that BAM would set those priorities only for those hosts but somehow resulted in a reset of other settings at the project level at the project site?
Tuna
| |
|
|
|
That change of Priority from 100 to 200 happened about two weeks ago.
To be more accurate, that change seems to have happened before 3/30, looking at some posts I had made on BS. And, probably after 3/15. So, "two weeks ago" is not exactly correct. It is more like 2-4wks ago.
Michael: Can you please check to see if this host, for instance, is really getting random tasks? I know you said that there is no guarantee since there are no location prefs left on my account anymore, but suspiciously this host seems to be still getting mostly GFN-22s compared to other machines. And, other hosts also seem to be getting what they are supposed to be, but I didn't analyze them deeply. I am hoping that some data in your DB is still aware of my last location settings per host, thus still send the "right stuff" to the hosts without needing to look at the actual location preferences, which you might be able to extract, out of which I can reconstruct the locations from scratch.[/i] | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
Oh, my!!! Can you see in the database when the last time a location was deleted under my account?
The database doesn't keep an audit log of those changes. The best we can do is start looking at the backups. No promises as to when (or even if) that might happen. As you might imagine, it's both time and labor intensive.
As for ideas, look at my PS section in my post. That change of Priority from 100 to 200 happened about two weeks ago. I wonder if when BAM asked PG to make that change, PG decided to make the change and delete all locations.
AH!
That might be the culprit.
The celestial locations are a PrimeGrid exclusive. No other BOINC project has them, and BAM doesn't know about them or support them. I wouldn't be surprised if using BAM (or any other remote account manager tool) is the underlying cause of the problem.
Dangit! And, I don't think I kept any records from a year ago as to what each location was doing... Even if I wrote it down somewhere, wouldn't know where it is right now. No way you can retrieve from any old records, right? I am sure deleted rows keep getting purged from the db.
Again, no promises, but I'll see what we can do.
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
That change of Priority from 100 to 200 happened about two weeks ago.
To be more accurate, that change seems to have happened before 3/30, looking at some posts I had made on BS. And, probably after 3/15. So, "two weeks ago" is not exactly correct. It is more like 2-4wks ago.
Michael: Can you please check to see if this host, for instance, is really getting random tasks? I know you said that there is no guarantee since there are no location prefs left on my account anymore, but suspiciously this host seems to be still getting mostly GFN-22s compared to other machines. And, other hosts also seem to be getting what they are supposed to be, but I didn't analyze them deeply. I am hoping that some data in your DB is still aware of my last location settings per host, thus still send the "right stuff" to the hosts without needing to look at the actual location preferences, which you might be able to extract, out of which I can reconstruct the locations from scratch.[/i]
There's nothing I can see beyond what you can see.
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
PS: In the off chance that this is related: A few weeks ago I changed the priority of PG from 100 to 200 in BOINC Account Manager site, which properly communicated with PG to set it to 200 in the non-location PG settings. I wonder if that broke some sort of a connection between the location vs. non-location settings in my PG account for display-only purposes.
Pretty sure that's what did it. I did that with BOINC Stats for a couple projects on different hosts and while it did change the resource settings, it also reset everything else at the project site to the defaults.
Edit: to clarify it reset per host. The ones I didn't change the resource settings on were unaffected.
Sounds like a smoking gun to me. :)
____________
My lucky number is 75898524288+1 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
|
Tuna, do you have an idea of approximately when this happened? Restoring backup databases takes a while, and I'd prefer to do it just once rather than randomly trying to guess how far back I need to go.
____________
My lucky number is 75898524288+1 | |
|
|
|
There's nothing I can see beyond what you can see.
Thanks. I guess I was just hoping that there was some sort of per-host caching of the subproject selections for that host rather than every TaskRequest from BOINCMgr resulting in retrieving the location based preferences for that host, over and over again, and then the cache would get invalidated when the location prefs would actually change. Thinking too much like a db developer... ;) | |
|
|
|
Tuna, do you have an idea of approximately when this happened?
I know the changes were already complete by 3/30, since I posted something to BS forum about having done it recently. So, best guess is 3/20-3/30. Sorry, don't know the exact date.
Audit logs are good things, but take up space, right?
EDIT: I'm gonna guess that if you had a backup from around 3/15 or late 2016, that backup should contain the location prefs.
Tuna | |
|
|
|
Or, you changed the values by going into one of your hosts on https://boincstats.com/en/bam/hosts/ and click Edit Projects and then change defaults for a few projects in that page, hoping that BAM would set those priorities only for those hosts but somehow resulted in a reset of other settings at the project level at the project site?
Tuna
Well crap.. I think I did use the "My Projects" page because I have "Success" under the Last Attempt column. I may have confused myself because I do use the defaults on some Host/Project combinations and obviously wouldn't have had an issue with those being reset.
Edit: I should have quoted the first part of your post, not the second... feels like Monday already. | |
|
|
|
Well crap.. I think I did use the "My Projects" page because I have "Success" under the Last Attempt column.
That is what I did, too. Actually, at the time, I hadn't realized that BAM gave (or, at least looked like it gave) the tools to change the project priority per managed host. So, I did the only thing I knew how to.
Just went through all project sites, checking my account and the project prefs. Strangely, my usual "interesting" default settings (TestApps=Yes, AllProjects=Yes, OtherAppsIfNoTasksInSelectedApps=Yes) were haphazardly changed, or not. One project would have all these reset to NO, another would have them all still at YES, other few had only a subset reset to NO, among all the projects that I had changed to be different than pri=100. Weird.
Now I know NOT to change my priorities in BAM, but directly on project sites...
Tuna
PS: Reported to Willy@BS as part of https://boincstats.com/en/forum/18/11507 | |
|
Michael Goetz Volunteer moderator Project administrator
 Send message
Joined: 21 Jan 10 Posts: 14572 ID: 53948 Credit: 911,248,965 RAC: 1,166,594
                                      
|
|
Tuna,
I've restored your settings to what they were on December 25th. Please check it out to make sure I didn't mess it up.
Mike
____________
My lucky number is 75898524288+1 | |
|
|
|
I've restored your settings to what they were on December 25th. Please check it out to make sure I didn't mess it up.
Yes! Yes! Yes! Thank you so much!
At a first glance, it is all good.
Of course this rolled back my resshare for PG from 200 back down to 100, and the machines I had enabled AP27 on are no more (thus, no host will run AP27 now), but these are easy fixes. This also will give me a chance to print it out, audit and adjust.
Again, thanks!
Tuna
| |
|
Message boards :
Number crunching :
Is there a problem with the location specific PrimeGrid Preferences pages?? |