Fixes #6919, do not check for host in regex group in log importer if format has no regex. Also add nginx json log to log importer system test.

Adding support for parsing amazon cloudfront log files in log importer & making W3cExtendedFormat treat time-taken field as seconds by default (since that is what the W3C format specifies). Also add support for event tracking and cloudfront RTMP logs (which provide event logs). Also allow multiple spaces in between W3C extended log files. Allow derived classes of W3cExtendedFormat to define new custom field regexes.

Refs #6795, add --iis-map-field option to allow users of log importer script to parse log files created using the IIS Advanced Logging module. Includes tests for such a case (including python unit test + PHP System test).

Fixing some tests, make sure processed metrics are computed even if generic filters disabled, and do not apply queued filters in datatablemanipulators when fetching subtables.

refs #5940 moved files into a subfolder framework, added autoloader to remove duplicated code to load autoload.php and to be able to register more autoloaders (eg for test files) on demand. This I got read of many includes that had to be updated all the time and that had to be updated all the time when moving iles

refs #5940 we might stay backwards compatible this way for 2 months. moved some tests from unit to integration and explained when a test is a unit test, an integration test or a system test.

refs #5940 put tests in correct folders, better testsuite names, some tests still fail and I cannot figure out why

Refs #5800, add namespaces to integration tests in root folder. Also add IntegrationTestCase to a namespace, re-add individual test @groups, move test groups to class level, and rename test files & class names so underscores are not used.

Piwik is a free/libre analytics platform. Refs #4455 GNU Package requirement to use free/libre instead of open source

Forcing all recorders and recorders max payload to 1, to prevent random behavior (eg. in Live.getLastVisitsDetails, the pageIdAction may be random order if recorders import data in random thread order)

refs #3786 let the build fail by expecting MultiSites.getAll works with daterange and returns websites having 0 visits

Added namespaces to functions.php files in the five plugins that had one
Work in progress

Converting Access & Auth to namespace

Notes:
  - Modified ManySitesImportedLogs fixture to add segments if desired.
  - Switch to synchronous execution of curl requests until deadlocking issue in archive processing is dealt with.
  - Fixed bug in LogAggregator where if a segment required a subquery, archiving would failed.

Make Piwik_Access a singleton instance and remove use of Zend_Registry for the Piwik_Access singleton.

Converting Piwik core source files, PHP, JS, TPL, CSS

More info: http://piwik.org/participate/coding-standards/

CORE

 * formatting sub-second times
 * getColumn() method on data table array (in order to behave the same as the regular data table class)
 * data tables can store in their meta data, which columns are empty (this is used in order to dynamically hide the new "generation time" column)
 * ViewDataTable and Api.getProcessedReport act according to the empty column meta data


SCHEMA

 * new column custom_float_1 in log_link_visit_action
 * new version to apply the change


TRACKER

 * Piwik_Tracker::setGenerationTime
 * tracking parameter "generation_time_me"
 * value is stored in new custom_float_1 column
 * the log importer can handle a group "generation_time_micro" which can be used in a custom log format. _micro is used because apache can log the time in microseconds but piwik processes milliseconds.
 * note: extension of JS tracker still missing


ACTIONS PLUGIN

 * for pages and page titles, add new columns sum_time_generation and nb_hits_with_time_generation to the blob archives
 * if they are set, compute avg_time_generation on the API level. if not, remove the columns and mark them as empty in the data table meta data.
 * show new column "avg. generation time" in the pages and page titles reports


plus TESTS for everything

Refs #2908, refactored tests so database setup (adding sites, tracking visits) are separated from API tests. Put setup code into fixtures and reused code as much as possible.

 
 Fixing the problem of the midnight test: instead of skipping, we should just ignore the test.

git-svn-id: http://dev.piwik.org/svn/trunk@7785 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@7732 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@7573 59fd770c-687e-43c8-a1e3-f5a4ff64c105