Adding timing feature to test harness and report

This adds a simple timer in the test harness using
elapsed time based on `date %s`. Having O(0.1) second
errors O(10^3) tests can give O(10^2-3) sec

Adding timing feature to test harness and report

This adds a simple timer in the test harness using
elapsed time based on `date %s`. Having O(0.1) second
errors O(10^3) tests can give O(10^2-3) seconds errors
so for total timing, the numbers may be a bit suspect.

However, for figuring out what tests are taking the longest
time, the elapsed time is now written out the counts file,
and report_tests.py can show the top n times that
are the longest, along with the tests associated with it.
Documentation upgraded to show new feature.

Example:
```
gabrielle 154: config/report_tests.py -t 3
```

show more ...

Merge branch 'scott/ksp-ksp-tutorials'

Fix for name changes in report

Because the names in the makefile no longer have run in them,
need to make sure report_tests gives the right search name

Merge branch 'barry/tao-to-new-test-harness' into barry/all-new-test-harness-branches

Merge branch 'barry/move-to-new-test-harness' into barry/all-new-test-harness-branches

Merge branch 'master' into knepley/feature-plex-adjoint-prelim

* master: (60 commits)
petsc4py: update to use latest 3.8 snapshot
petsc4py: update to snapshot that syncs with 276c550
fix warni

Merge branch 'master' into knepley/feature-plex-adjoint-prelim

* master: (60 commits)
petsc4py: update to use latest 3.8 snapshot
petsc4py: update to snapshot that syncs with 276c550
fix warning
Plex ex26: Protect ExodusII stuff
DM: DMCreateSubDM() field argument should be const
TS ex46: Newlines and some numerical jitter
TS ex45: Newlines and some numerical jitter
TS ex11: Fixed indentation and time step numbering
SNES ex12: Update for DM view changes
Plex tests: Update to new DM output
Plex ex23: Use Nc not dim for vector fields
Plex: Default section now ignores cells hanging off boundary meshes
Plex: Viewer now reports the cell Height
Increase patchlevel to 3.8.3
Plex: Fixed DMPlexInterpolate() bugs - Do not copy associated data if we are not interpolating - Do not interpolate if we already have full depth
fix valgrind errors with using PetscObjectGetName()/SetName() with the same object - resulting in a free() before copy.
ex4: fix compile warning and update makefile
Minor fixes
Improving report_tests
PetscDS: Must initialize the default adjacency
...

Conflicts:
include/petsc/private/dmimpl.h
include/petscdm.h
include/petscis.h
src/dm/impls/plex/plexcreate.c

show more ...

Merge remote-tracking branch 'origin/scott/test-harness-report_tests_fix'

Merge branch 'master' into knepley/feature-plex-adjoint-prelim

* master: (251 commits)
yaml: add a backup download URL
Fix documentation of MatSetRandom function
Ignore -malloc-hbw option if m

Merge branch 'master' into knepley/feature-plex-adjoint-prelim

* master: (251 commits)
yaml: add a backup download URL
Fix documentation of MatSetRandom function
Ignore -malloc-hbw option if malloc is already set
Plex: Fixed array initialization
pgi: compile fix
knl: update test to use memkind and remove option that worked arround a bug with intel 17
Check the return value for memkind_posix_memalign
Change the default behavour for -malloc_hbw
Bib: More refs
test: remove runex13f90 as its now converted to new test suite
fix win32 crash. This test was previously run with '-n 4' - so restoring it
Fix petscsfgetgraph_ to work for all Fortran compilers by directly using array of PetscSFNodes
bugfix for MatDuplicate_MPIAIJ_PtAP Reported-by: Samuel Lanthaler <s.lanthaler@gmail.com>
strip out dead sundials usage code; change sundials test to only run 5 timesteps to prevent different number of steps on different systems.
Remove extra lines of output file
Example uses C99 constructs so must mark with requires: c99
fix const missmatch for DMDAVecRestoreArrayRead()
remove conflict between function name in example and new PETSc TS function
builds: attempt to do maint/master/next test builds in separate clones
ex62: it turned out that CHACO partioning is not deterministic. Use a prescribed partition instead
...

Conflicts:
src/dm/interface/dm.c
src/snes/examples/tutorials/ex13.c

show more ...

Improving report_tests

Adding some improved reporting of how to rerun the test system based on
Satish's suggestions.

Merge remote-tracking branch 'origin/scott/test-harness-improve2'

Merge branch 'master' into knepley/fix-plex-bc-multiple

* master: (347 commits)
tests: add 'PETSC_HAVE_C99' flag - so that 'requires: c99' can be used in the test suite
PGI: fix build error with

Merge branch 'master' into knepley/fix-plex-bc-multiple

* master: (347 commits)
tests: add 'PETSC_HAVE_C99' flag - so that 'requires: c99' can be used in the test suite
PGI: fix build error with updated 17.10 compilers
Fix for test dirs that are not tutorials/tests
fix use of double in PetscAbsReal() which produces compiler warnings with single precision build
elemental: remove info on conflict of -with-cxx-dialect=C++11 on osx - it works now.
Cleanup .bib files
Fix allfortranstubs rule to rm generated files from correct directory, not outdated location
ierr set but not checked
Remove initial refine so test runs faster and does not time out on some machines
Gail's copyedits for bibtex items
Docs: manual: add further description of 3 different current testing options
DM: check for ops->localtolocalbegin/end before calling
PetscSF: fix typo in tutorial ex1
Vec+HDF5: Fix output for complex - Need to check for empty group name
SNES: SNESDestroy() can be called with snes->dm == NULL
SNES: SNESDestroy() can be called with snes->dm == NULL
Vec+HDF5: Fix output for complex - Need to check for empty group name
Docs: Manual: Update tests section
gmakegentest: also exclude .#filenames created by emacs
DMPlex: Fix output of test ex1 after changes to Gmsh reader
...

show more ...

test: restore $(PETSC_LIB) to example link targets

And skip 'To rerun failed tests:' message when there are no failures

Don't report FAILED if no failures

Merge remote-tracking branch 'origin/scott/test-harness-installtest'

Add feature that Jed requested in PR #739

It is difficult to rerun failed tests partially because of the mapping
of makefile targets (which are oriented to the scripts that are being
run), and the t

Add feature that Jed requested in PR #739

It is difficult to rerun failed tests partially because of the mapping
of makefile targets (which are oriented to the scripts that are being
run), and the test names that are actually reported (which are
oriented around individual tests being run, including for loop names,
test sets, etc.). A set of regex's are used to provide the inverse
name mapping that is implicit in testparse.py to provide a command
to enable people to copy and paste the line.

show more ...

Merge branch 'jed/cleanup-report-tests'

* jed/cleanup-report-tests:
gtest: remove commas from report_tests.py (easier list processing of output); support Python-3

gtest: remove commas from report_tests.py (easier list processing of output); support Python-3

Merge branch 'master' into knepley/feature-plex-sphere-mesh

* master: (2633 commits)
Bib: Added ref
SNES ex56: Update test output
add a citation to petsc.bib
Plex: Initialize variables
ini

Merge branch 'master' into knepley/feature-plex-sphere-mesh

* master: (2633 commits)
Bib: Added ref
SNES ex56: Update test output
add a citation to petsc.bib
Plex: Initialize variables
initialize ap as complained by the nightly tests
Plex ex3: Update to new point function API
initialize some variables as complained by nightly tests
SNES ex12: Mix misnaming Nf --> Nc
update tests
add tests
add MatView_SeqXAIJ_ASCII_structonly(); enable A->structure_only in MatSetValuesBlocked_SeqBAIJ
typo
fill-in some references
Bib: Fixed ref
Plex: Added PLY to file support
Plex: Adding PLY support
PetscDS: Turn off Fortran bindings for Constants
Plex tests: Updated to new point function API
SNES ex56: Moved tests to new format
DM: Allow field projection functions to take an array of scalars - This will allow us to pass in user data to kernels without void *, more efficiency than aux fields
...

Conflicts:
config/builder.py
include/petscdmplex.h
src/dm/impls/plex/examples/tests/ex1.c
src/dm/impls/plex/plexcreate.c
src/dm/impls/plex/plexgmsh.c
src/snes/examples/tutorials/ex63.c

show more ...

Merge branch 'master' into knepley/feature-plex-pragmatic-parallel

* master: (1379 commits)
Minor fixes for tchem examples due to changes in PETSc infrastructure
update webpage about API changes

Merge branch 'master' into knepley/feature-plex-pragmatic-parallel

* master: (1379 commits)
Minor fixes for tchem examples due to changes in PETSc infrastructure
update webpage about API changes
add help menu for MatCreateSubMatricesMPI()
rename struct Mat_SubMat -> Mat_SubSppt
add a little information to the manual about using tchem
rename MatCreateSubMatrixComposite -> MatCreateSubMatrixVirtual; Mat_SubMatrix -> Mat_SubVirtual
need to protect the \ passed on the makefile on my Mac
Bib: Updated ref
update src/mat/examples/tests/output/ex23_#.out
rename MatGetSubMat -> MatCreateSubMat
Mark MatCreateMPIAIJWithSplitArrays() and MatMPIAIJSetPreallocationCSR() with MAT_NO_OFF_PROC_ENTRIES
superlu: libray is installed in PREFIX/lib64 - fix this to use PREFIX/lib
backport fixes cc105cc3 2b35c90a - required for 3bf428d - that was backported from master - 80c96bb
'echo -n' fails on opensolaris/osx - so avoid using it.
fix diffs in nightlybuilds due to options in ~/.petscrc
add Kelley03 to src/docs/tex/petsc.bib
build: determine moudles, mpi.h used during buildtime and print in 'info'
fix analyzer warnings
fix build failure on opensolaris - where -lm from flibs is removed due to -lm in cxxlibs. But then - only flib gets used for some configure tests [blaslapack, parms]
config: prefer __restrict over C99 restrict keyword
...

show more ...

Merge branch 'master' into knepley/fix-plex-examples-cleanup

* master: (156 commits)
Doc: Added headers for documentation sections
Bib: Small corrections
doc: update example makefiles with del

Merge branch 'master' into knepley/fix-plex-examples-cleanup

* master: (156 commits)
Doc: Added headers for documentation sections
Bib: Small corrections
doc: update example makefiles with deleted sourcefile info
doc: fix manual build errors
doc: fix SOURCEH for some fortran includes that got moved
doc: fix broken manualpages - bug introduced by 1b266c9
MatMissingDiagonal() is actually not a collective operation
PetscFECreateDefault(): allow 0th order quadrature
fix gmakegentest.py to ignore *.xx files that are not source code but are in the files
increase table input size to (A->cmap->n + a->B->cmap->N) for MatTransposeMatMultSymbolic_MPIAIJ_MPIAIJ()
gtest: add TEST and RM clean output for Satish
gtest: set PATH for windows DLL tests, and enable -Dpetsc_EXPORTS only during (dll) build - and not for examples
gtest: use target-specific var to deduplicate FC rules for modules
gtest: for 'allgtest' and 'allgtest-tap' - use V=0 instead of 'grep -v CC' etc..
gtest: quiet absoft compiler commands [so they can be filtered].
remove incorrect requires from more test files, remove output from -fp_trap example in test because it cannot be machine independent
gtest: windows fixes. add filter to remove filename from compiler stdout. And fix filters to use petscdiff
Removed generated requires in the wrong place from test examples.
Fix test output for additional information printed about computed eigenvalues
gtest: fix ex5f.F to use 'format' so that the output from ifort matches the one from gfortran
...

show more ...

Merge branch 'scott/testharness-update1'

gtest: report_error.py: better message when no tests have been run

Merge branch 'scott/testharness-update1' of bitbucket.org:petsc/petsc into scott/testharness-update1

Merge branch 'scott/testharness-update1' of https://bitbucket.org/petsc/petsc into scott/testharness-update1

python: fix format for 2.6 [for opensolaris]

Traceback (most recent call last):
File "config/report_tests.py", line 61, in <module>
main()
File "config/report_tests.py", line 58, in main

python: fix format for 2.6 [for opensolaris]

Traceback (most recent call last):
File "config/report_tests.py", line 61, in <module>
main()
File "config/report_tests.py", line 58, in main
summarize_results(directory)
File "config/report_tests.py", line 37, in summarize_results
prcnt="{:3.1f}".format(percent)
ValueError: zero length field name in format

show more ...