Pages: [1]
BarryAZ
BAM!ID: 2328
Joined: 2006-06-18
Posts: 24
Credits: 0
World-rank: 0

2011-06-23 18:07:38

Has anyone gotten any information from the folks at Aqua? That project has been quite reliable with fairly active admin feedback over the year, and this past weekend their database servers went offline and then their home page went to 'you can't ping me' mode on Tuesday and remains that way as I type this.

Odicin
BAM!ID: 97175
Joined: 2011-02-21
Posts: 20
Credits: 30,621,601,186
World-rank: 184

2011-06-24 21:53:23

Hi Peter!

I'm Neo on the AQUA@home forum. Unfortunately, I ran a maintenance
script in the wrong directory on the AQUA@home server (on Monday, I
think), which then deleted a few critical BOINC config files instead of
the old files it was supposed to delete. After that, pretty much
everything slowly stopped working, and I didn't figure out what had
happened until the next day. To avoid more problems, we've turned the
server off until Boinc Admin gets back from vacation on Monday. He'd
probably (hopefully) know enough of what was in those configuration
files that we can start from a very old backup and make the necessary
updates to those. If not, there's very small chance that we can recover
the deleted files.

Morals of the story:
* Don't assume that there are recent backups
* Scripts that delete files en masse should require the user to specify
the directory or use an absolute address instead of assuming the current
directory

Hopefully we can recover, and hopefully people aren't too angry at us.
Sorry for the inconvenience.

Sincerely,
Neil


From Here.

Regards Odi
BarryAZ
BAM!ID: 2328
Joined: 2006-06-18
Posts: 24
Credits: 0
World-rank: 0

2011-06-24 23:13:22

Thanks for that update -- looks like Aqua will be back up and running sometime next week.
BarryAZ
BAM!ID: 2328
Joined: 2006-06-18
Posts: 24
Credits: 0
World-rank: 0

2011-06-28 04:34:02

I was kind of hoping to see an Aqua home page late today (not expecting to see the database restored for a few days), but no home page either -- guess things were well and truly munged over there.
Odicin
BAM!ID: 97175
Joined: 2011-02-21
Posts: 20
Credits: 30,621,601,186
World-rank: 184

2011-06-28 21:08:05

Aqua is up now with good news:

AQUA server is recovering from a serious problem
Last week the AQUA server had to be shut down because many configuration files were accidentally deleted. We are working on gradually repairing the damage, and will start submitting new work as soon as we are reasonably confident that everything is fine. This could take a few days. We believe the database is intact and no one has lost any credit. We apologize for any inconvenience this may have caused our volunteers.


Regards Odi
Tomasz R. Gwiazda
 
BAM!ID: 66904
Joined: 2009-03-20
Posts: 16
Credits: 1,338,358,712
World-rank: 1,841

2011-06-29 06:55:12

BarryAZ
BAM!ID: 2328
Joined: 2006-06-18
Posts: 24
Credits: 0
World-rank: 0

2011-07-08 05:40:11

Yes, Aqua recovered from their outage -- but it seems in implementing the latest BOINC server software they re-visited a massive credit bug (in the BOINC server code) which has resulted in some VERY high credit scores.

Aqua admins state the problem is in the BOINC server code, though the problem *appears* to be Aqua specific. This looks like the same massive credit score problem that showed up one month ago (perhaps with the June BOINC server update) and was resolved with a BOINC server code 'hot fix' (I'm guessing here) a few days later. My *guess* is that the July BOINC server update 'un-fixed' the hot fix and so the problem resurfaced.

While the Admins are manually adjusting work unit credits, the Aqua server configuration drops results out of the database very quickly (seems like less than 24 hours after a result completion). Those work units with really high scores that didn't get adjusted before the auto-purge of the database remain with credits. Back in June that pushed my RAC rank from 12 to 87 since I didn't get any of the super credit work units. This time I got a handful of them and they went to autopurge before the admins adjusted them. So my RAC (which had been recovering to 26 as the averages cleared out over time) jumped from 26 to 7. My credits jumped by close to 400 MILLION. I don't know if the Aqua admins are going to clear these out (I'm certainly not the only one getting these super credit work units), but if they don't, I end up with a major stat report anomaly. I'd rather see the credits fixed (including the ones purged from the database) but it is one of those -- is what it is -- things.
BarryAZ
BAM!ID: 2328
Joined: 2006-06-18
Posts: 24
Credits: 0
World-rank: 0

2011-07-08 19:02:25

From the Aqua project admins late this morning:

"In preparation for a credit rollback, I've emptied the queues of all work. Please feel free to cancel any tasks that you may be running.

Please run tasks from other BOINC projects till we sort out this credit mess."

Basically, aside from the message boards, consider Aqua to be offline -- best case -- some time next week.
BarryAZ
BAM!ID: 2328
Joined: 2006-06-18
Posts: 24
Credits: 0
World-rank: 0

2011-07-08 22:06:25

Looks like the credit problem has to do with the BOINC centralized directorate trying to impose a single credit scheme for all projects within the Server code and disabling project specific credit systems.

Projects not implementing the 'latest and greatest' Server code don't encounter this problem. Perhaps an increasing number of projects are going into server code 'hold mode' to avoid the centralized scheme and the problems that come with it.
wertperch
 
Tester
BAM!ID: 86245
Joined: 2010-06-08
Posts: 80
Credits: 1,342,967
World-rank: 182,952

2011-08-05 23:09:17

Do AQUA still grant those insane amount of credit, or is that fixed now?

I also shoot cancer with a 686 Magnum
Zydor
 
Tester
BAM!ID: 65177
Joined: 2009-02-06
Posts: 283
Credits: 2,139,882,904
World-rank: 1,302

2011-08-06 20:35:09

Aqua is on hold - the Admin left DWave (would be wrong to connect assumed dots), and at present the future of the BOINC end of the Project is not clear. There are some test WUs still going through, but they will be all returned shoertly. No other WUs yet available, not yet known when or if that will be.

Its a wait and see job.
reklov
BAM!ID: 32502
Joined: 2007-08-15
Posts: 32
Credits: 144,316,996
World-rank: 8,958

2011-10-27 18:00:52

Here we can read an intrerview with the CTO of D-Wave Systems. in the FTD Deutschland Boinc is not mentioned
Pages: [1]

Index :: The Projects :: Aqua status??
Reason: