Page 1 of 1

Elmer/Ice tests

Posted: 21 Dec 2017, 19:04
by rgladstone
Hi all, I have made a couple of minor code updates recently and I find that I am getting a significant number of failures when running the tests. Do the tests work for anyone else? I am particularly keen to hear from anyone who regularly makes code commits. It would be reassuring to get a clean set of test results before pushing to the repository! In particular, here are the tests that fail for me:

7/585 Test #7: Contact .................................................***Failed 12.22 sec
12/585 Test #12: InvMeth_AdjRobin ........................................***Failed 435.98 sec
13/585 Test #13: IntegratedVelocity ......................................***Failed 0.62 sec
15/585 Test #15: Glen_2D .................................................***Failed 37.07 sec
33/585 Test #33: Teterousse_DeformHeat ...................................***Failed 507.41 sec
38/585 Test #38: InvMeth_AdjBeta .........................................***Failed 497.46 sec
40/585 Test #40: InvMeth_AdjMu ...........................................***Failed 376.09 sec
41/585 Test #41: Grid2DInterpolator ......................................***Failed 351.87 sec
42/585 Test #42: ScatteredDataInterpolator ...............................***Failed 0.22 sec
43/585 Test #43: GL_MISMIP ...............................................***Failed 146.27 sec
44/585 Test #44: SIA .....................................................***Failed 17.47 sec
147/585 Test #147: HeatPlateSym ............................................***Failed 0.64 sec
205/585 Test #205: BlockPoisson2 ...........................................***Failed 0.14 sec

Some of these failures might have simple explanations. For example I suspect my ScatteredDataInterpolator test failed due to some missing prerequisites.

I checked one test in more detail. The Contact test failed due to the result being outside the tolerated range. But it was only out by a small margin. Maybe an acceptable margin, but who makes that decision?

Thomas Zwinger tried running just the fast elmerice tests earlier today and Emergence and IntegratedVelocity failed for him.

Is anyone in charge of the Elmer/Ice tests at the moment?

Regards,
Rupert

Re: Elmer/Ice tests

Posted: 10 Apr 2018, 10:48
by fgillet
Hello Rupert,

thanks for the report and sorry for the late reply.
At Grenoble we are running all the Elmer/Ice tests, after each code revision.

I try to keep an eye on the results as much as I can.
I have updated most of the tests with failure.
On the 52 elmerice tests (ctest -L elmerice); There is still 2 tests that report a failure for me.
45 - Teterousse_DeformHeat (Failed)
17 - MISMIP_FS-SSA (Failed)

I will try to fix these tests too in a ner future.

fabien

Re: Elmer/Ice tests

Posted: 10 Apr 2018, 13:09
by rgladstone
Thanks Fabien, I will run the tests again on my laptop when I get the chance and will report in more detail if there are still tests other than the two you mention that fail for me. Could be a few weeks though as I'm rather busy at the moment!

Regards,
Rupert