Index  | Recent Threads  | Unanswered Threads  | Who's Active  | Guidelines  | Search
 

Quick Go »
No member browsing this thread
Thread Status: Active
Total posts in this thread: 17
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread
Author
Previous Thread This topic has been viewed 19454 times and has 16 replies Next Thread
tekennelly
Cruncher
Joined: Oct 10, 2005
Post Count: 45
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
smile FIghtAids work units seem to dominate?

Currently my profile is set up to include all current projects (i.e., Zika, Ebola...). It seems that the FightAids work units always have the shortest deadline and therefore cause work units from other projects to wait.

I currently download 7 days of work. As a work around, after the download completes. I disable "allow new tasks" so that I can get a more even distribution of work from all projects. Of course, the FightAids work units come in with the shortest time so they go into immediate execution. Eventually the FightAids work units complete and other work can begin.

So, my question is whether FightAids work units are given appropriate time deadlines in balance with the other projects.
[Jul 7, 2016 5:34:18 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

It depends on how deep you set your buffer. Rule of thumb... keep your Minimum Buffer to -less- than half of the shortest deadline and keep the MaxAB [Max Additional workBuffer] to zero. With that rule applied, the order will be FIFO, first In First Out. As FAH2 is 4 days [always I think], the setting has to be < 2.0 days or they will most always jump the queue and in your case they will always, since the buffer is greater than 4 days anyhow [If you only set FAH2 with that buffer size, you might even incur "will not finish in time"]

Remember with a 2 day buffer, the work started is already 2 days old, so you still might see the occasional EDF [Earliest deadline first], when repair job arrive, who's deadline is, except for FAH2, about 2.8 to 3.5 days for production work. Think also the HST1 is always 10 days, so they will hardly get rush treatment.

BTW the deadline is predicated on the sequence dependencies. Your result is the immediate base for the next task. With a 4 day deadline and 30 dependent tasks in a sequence it means that getting one final result, number _30 to the scientists could take up to 120 days, for the -ls- type even 160, though by observation it seems to take somewhere from 75 to 110 days.
----------------------------------------
[Edit 1 times, last edit by SekeRob* at Jul 7, 2016 6:01:12 PM]
[Jul 7, 2016 5:56:39 PM]   Link   Report threatening or abusive post: please login first  Go to top 
tekennelly
Cruncher
Joined: Oct 10, 2005
Post Count: 45
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

Ok. Set buffer to 1.5 days and will monitor. Thanks.
[Jul 7, 2016 8:40:02 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

There's another form of domination... whenever having multi-project selection and including FAH2, excluding MCM, hardly anything but FAH2 will come. This is aggravated because FAH2 run 14 hours on my 8 core desktop, UGM not coming at all doing 4 hours if fetched manually and the few OET/Zika not even doing 2, so the contribution ratio is completely out of whack. The old question is still up on going: What's the point of multi-project selection pretty plz?
[Aug 9, 2016 12:15:09 PM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

You can also use an app_confile file to set how many of each task can run at the same time. That will probably not change the amount downloaded of each task but it will help you balance the running tasks for each project.
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[Aug 9, 2016 2:21:12 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

If you forget you end up with a full buffer and idle cores, buffer so full, not even work from backup is being fetched. The solution was/is nice to control CEP2 and other heavies, but WCG broke the priority distribution for this science, no continuous crunching on restricted cores and still ending up with idle resources. 😵
[Aug 9, 2016 3:07:58 PM]   Link   Report threatening or abusive post: please login first  Go to top 
enels
Senior Cruncher
Joined: Apr 25, 2008
Post Count: 286
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

The WCG staff have huge levers to prioritize projects. Presumably they are happy with the distribution.

If you are not happy you may do better discriminating between the projects you select.
[Aug 9, 2016 5:02:00 PM]   Link   Report threatening or abusive post: please login first  Go to top 
SekeRob
Master Cruncher
Joined: Jan 7, 2013
Post Count: 2741
Status: Offline
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

One thing which would substantially enormously help, not sure if not proposed before, but back when there was uproar over CEP2, techs, knreed if I remember correctly, skunk-worked in the 'how many to assign for CEP2... 1-16, unlimited' within hours, less than a day. In pact with app_config this worked superb. Same could be worked in for the very long running FAH2 (and HSTb maybe too)... really like to get to rid myself of this hunter-gatherer perpetual profile manipulating to share the resource (those with a farm have easy talking ;o))), so techs can you pretty plz set your iron-glad immovable schedule aside for a few hours and proof you can still do quick solution works and make more than a few campers happier. praying
[Aug 9, 2016 5:47:15 PM]   Link   Report threatening or abusive post: please login first  Go to top 
nanoprobe
Master Cruncher
Classified
Joined: Aug 29, 2008
Post Count: 2998
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

One thing which would substantially enormously help, not sure if not proposed before, but back when there was uproar over CEP2, techs, knreed if I remember correctly, skunk-worked in the 'how many to assign for CEP2... 1-16, unlimited' within hours, less than a day. In pact with app_config this worked superb. Same could be worked in for the very long running FAH2 (and HSTb maybe too)... really like to get to rid myself of this hunter-gatherer perpetual profile manipulating to share the resource (those with a farm have easy talking ;o))), so techs can you pretty plz set your iron-glad immovable schedule aside for a few hours and proof you can still do quick solution works and make more than a few campers happier. praying

+1000
----------------------------------------
In 1969 I took an oath to defend and protect the U S Constitution against all enemies, both foreign and Domestic. There was no expiration date.


[Aug 10, 2016 11:25:20 AM]   Link   Report threatening or abusive post: please login first  Go to top 
uplinger
Former World Community Grid Tech
Joined: May 23, 2005
Post Count: 3952
Status: Offline
Project Badges:
Reply to this Post  Reply with Quote 
Re: FIghtAids work units seem to dominate?

Greetings,

The weights for projects are as follows on the feeder:

mcm1 - 41.67%
ugm1 - 1.04%
oet1 - 28.13%
fahb - 10.42%
hstb - 1.04%
zika - 12.5%

(I know this does not add up to 100%, we have beta apps as well as some rounding)

So, if you have mcm1 unselected, you may see more from fahb, this is because with shorter tasks from zika and oet1 when someone with that project selected specifically they will pull more results off the feeder at one time. They request 24 hours worth of work, they may pull many results off the feeder. But if they were to try to pull 24 hours for fahb, they may only pull like 4 out of say 40 sitting on the feeder.

There is no plan at the moment to limit the number of results per host for FAHB. The reason that cep2 has that option was due to the high IO for those work units.

As for our immovable schedule, the schedule changes from time to time. There has been an enhancement that I have been working on to potentially fix the download issues for members. Phase 1 of that was deployed yesterday without any members noticing or having issues. We are about to utilize a beta test to test phase 2 for this enhancement. I will explain more then. These are just enhancements that I was working on, others on our team are working hard on other important tasks as well.

Thanks,
-Uplinger
[Aug 10, 2016 5:37:14 PM]   Link   Report threatening or abusive post: please login first  Go to top 
Posts: 17   Pages: 2   [ 1 2 | Next Page ]
[ Jump to Last Post ]
Post new Thread