If SQLite is not installed, tasksTest fails in the most strange way.
$ php bin/prove.php
...
other/tasksTest.......................................................# Looks like you planned 4 test but ran 38 extra.
other/tasksTest......................................................dubious
Failed tests: 15, 21, 5, 23, 29, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42
Test returned status 255
Notice how tests numbers are reported incorrectly.
Now when ran by hand:
$ php other/tasksTest.php
1..33
ok 1 - symfony generate:project myproject returns awaited value (0)
ok 2 - generate:project installs the symfony CLI in root project directory
ok 3 - symfony generate:app frontend returns awaited value (0)
ok 4 - generate:app creates a frontend directory under apps directory
ok 5 - symfony generate:module wrongapp foo returns awaited value (1)
ok 6 - symfony generate:module frontend foo returns awaited value (0)
ok 7 - generate:module creates a foo directory under modules directory
ok 8 - symfony propel:build-sql returns awaited value (0)
ok 9 - propel:build-sql creates a schema.sql file under data/sql directory
ok 10 - symfony propel:build-model returns awaited value (0)
ok 11 - propel:build-model creates model classes under lib/model directory
ok 12 - symfony propel:build-form returns awaited value (0)
ok 13 - propel:build-form creates form classes under lib/form directory
ok 14 - symfony propel:insert-sql returns awaited value (0)
not ok 15 - propel:insert-sql creates tables in the database
# Failed test (/var/www/dev/playground11/lib/vendor/symfony/test/other/tasksTest.php at line 100)
Warning: rename(/var/www/dev/playground11/lib/vendor/symfony/test/other/../../lib/plugins/sfPropelPlugin/lib/vendor/propel-generator/database.sqlite): failed to open stream: No such file or directory in /var/www/dev/playground11/lib/vendor/symfony/test/other/tasksTest.php on line 101
Warning: rename(/var/www/dev/playground11/lib/vendor/symfony/test/other/../../lib/plugins/sfPropelPlugin/lib/vendor/propel-generator/database.sqlite,/tmp/symfony_cmd/data/database.sqlite): No such file or directory in /var/www/dev/playground11/lib/vendor/symfony/test/other/tasksTest.php on line 101
ok 16 - symfony propel:generate-crud --generate-in-cache frontend articleInitCrud Article returns awaited value (0)
ok 17 - propel:generate-crud initializes a CRUD module
ok 18 - symfony propel:init-admin frontend articleInitAdmin Article returns awaited value (0)
ok 19 - propel:init-admin initializes an admin generator module
ok 20 - symfony test:functional frontend articleInitCrudActions returns awaited value (0)
not ok 21 - test:functional can launch a particular functional test
# Failed test (/var/www/dev/playground11/lib/vendor/symfony/test/other/tasksTest.php at line 111)
# got: '# get /articleInitCrud/index
ok 1 - status code is 200
ok 2 - request parameter module is articleInitCrud
ok 3 - request parameter action is index
ok 4 - response selector body does not match regex /This is a temporary page/
not ok 5 - last request threw an uncaught exception PropelException: [wrapped: sqlite extension not loaded [User Info: Array]]
# Failed test (/var/www/dev/playground11/lib/vendor/symfony/lib/vendor/lime/lime.php at line 199)
1..5
Looks like you failed 1 tests of 5.
'
# expected: '# get /articleInitCrud/index
ok 1 - status code is 200
ok 2 - request parameter module is articleInitCrud
ok 3 - request parameter action is index
ok 4 - response selector body does not match regex /This is a temporary page/
1..4
Looks like everything went fine.
'
ok 22 - symfony test:functional frontend returns awaited value (0)
not ok 23 - test:functional can launch all functional tests
# Failed test (/var/www/dev/playground11/lib/vendor/symfony/test/other/tasksTest.php at line 114)
# got: 'articleInitCrudActionsTest...........................................not ok
Failed tests: 5
fooActionsTest.......................................................not ok
Failed tests: 4
Failed Test Stat Total Fail List of Failed
------------------------------------------------------------------
articleInitCrudActionsTest 0 1 1 5
fooActionsTest 0 1 1 4
Failed 2/2 test scripts, 0.00% okay. 2/9 subtests failed, 77.78% okay.
'
# expected: 'articleInitCrudActionsTest...........................................ok
fooActionsTest.......................................................not ok
Failed tests: 4
Failed Test Stat Total Fail List of Failed
------------------------------------------------------------------
fooActionsTest 0 1 1 4
Failed 1/2 test scripts, 50.00% okay. 1/8 subtests failed, 87.50% okay.
'
ok 24 - symfony test:unit test returns awaited value (0)
ok 25 - test:unit can launch a particular unit test
ok 26 - symfony test:unit returns awaited value (0)
ok 27 - test:unit can launch all unit tests
ok 28 - symfony test:all returns awaited value (0)
not ok 29 - test:all launches all unit and functional tests
# Failed test (/var/www/dev/playground11/lib/vendor/symfony/test/other/tasksTest.php at line 125)
# got: 'functional/frontend/articleInitCrudActionsTest.......................not ok
Failed tests: 5
functional/frontend/fooActionsTest...................................not ok
Failed tests: 4
unit/testTest........................................................ok
Failed Test Stat Total Fail List of Failed
------------------------------------------------------------------
end/articleInitCrudActionsTest 0 1 1 5
tional/frontend/fooActionsTest 0 1 1 4
Failed 2/3 test scripts, 33.33% okay. 2/10 subtests failed, 80.00% okay.
'
# expected: 'functional/frontend/articleInitCrudActionsTest.......................ok
functional/frontend/fooActionsTest...................................not ok
Failed tests: 4
unit/testTest........................................................ok
Failed Test Stat Total Fail List of Failed
------------------------------------------------------------------
tional/frontend/fooActionsTest 0 1 1 4
Failed 1/3 test scripts, 66.67% okay. 1/9 subtests failed, 88.89% okay.
'
ok 30 - symfony project:freeze /var/www/dev/playground11/lib/vendor/symfony/data returns awaited value (0)
ok 31 - project:freeze freezes symfony lib and data dir into the project directory
ok 32 - symfony project:unfreeze returns awaited value (0)
ok 33 - project:unfreeze unfreezes symfony lib and data dir
Looks like you failed 4 tests of 33.
You can see that the first one finds 42 tests while second finds 33, and the number of failed tests are not the same.
Lime should be fixed for thoose counts, and tests needing a particuliar php extension should not run into random results because an extension is not there.