git-svn-id: http://dev.piwik.org/svn/trunk@5141 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5140 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5139 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5138 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5136 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5135 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5134 59fd770c-687e-43c8-a1e3-f5a4ff64c105

Fixes #2649 - when a request with a segment that is part of the list of segments to pre-process, Piwik will now make sure that ALL reports are preprocessed, and not only the one requested

git-svn-id: http://dev.piwik.org/svn/trunk@5133 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5132 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5131 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5130 59fd770c-687e-43c8-a1e3-f5a4ff64c105

Refs #2633 - revert previous commits since they are temporary solution (final patch in the works by Timo)

git-svn-id: http://dev.piwik.org/svn/trunk@5129 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5128 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5127 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5126 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5125 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5124 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5123 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5122 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5121 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5120 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5119 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5118 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5117 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5116 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5115 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5114 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5113 59fd770c-687e-43c8-a1e3-f5a4ff64c105

 * Now catching exception thrown by Piwik_Http and simply reporting as network error
 * Added one line output summary for easy grep

 Example output:
 [2011-08-14 10:11:12] [bc1a080f] [6.38 Mb] done: 2/2 100%, 16 v, 2 wtoday, 2 wperiods, 24 req, 24019 ms, no error
 
 Example with error:
 [2011-08-14 10:25:16] [c80dec0b] [6.39 Mb] done: 18/21 86%, 248 v, 18 wtoday, 18 wperiods, 216 req, 122250 ms, 9 errors. eg. 'Got invalid response f
e=1&period=month&date=last52&format=php&token_auth=0b809661490&trigger=archivephp. Response was ''' 

git-svn-id: http://dev.piwik.org/svn/trunk@5111 59fd770c-687e-43c8-a1e3-f5a4ff64c105

 * Adding parameter to reset:
<reset[window_back_seconds]|forceall>: you can either specify 
	- reset: the script will run as if it was never executed before, therefore will trigger archiving on all websites with some traffic in the last 7 days.
			You can specify a number of seconds to use instead of 7 days window, for example call archive.php 1 reset 86400 to archive all reports for all sites that had visits in the last 24 hours

 * Also hopefully fixing client timeout error at 15s by default file_get_contents. Now using Piwik_Http with timeout 300 seconds, which should leave enough for websites to process.

git-svn-id: http://dev.piwik.org/svn/trunk@5110 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5108 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5107 59fd770c-687e-43c8-a1e3-f5a4ff64c105

 * Adding new script that will copy old visits/actions/conversions/purchased items from a date range (start,end) in TODAY. This is useful script to test the recent archive.php optimizations on a lot of data.
The only downside of this technique is that we effectively copy old data, therefore a few things are not as "varied" as they would be in prod, such as: Page URLs distribution (we "reuse" past URLs when normal piwik would always track new ones)

git-svn-id: http://dev.piwik.org/svn/trunk@5106 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5105 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5103 59fd770c-687e-43c8-a1e3-f5a4ff64c105

 * adding option forceall+reset which does imitate closely the current archive.sh behavior (with still the added bonus)
 Fixes #1938 added segment in lock name. I have tested the code path but haven't actually verifier that this improved performance

git-svn-id: http://dev.piwik.org/svn/trunk@5102 59fd770c-687e-43c8-a1e3-f5a4ff64c105

When running the archive.php script as CLI, and that piwik files were upgraded, fail gracefully and report as a critical error. Refs #2327

git-svn-id: http://dev.piwik.org/svn/trunk@5101 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5099 59fd770c-687e-43c8-a1e3-f5a4ff64c105

 * Added parameter <reset|forceall>: you can either specify 
	- reset: the script will run as if it was never executed before, therefore will trigger archiving on all websites with some traffic in the last 7 days.
	- forceall: the script will trigger archiving on all websites for all periods, sequentially


git-svn-id: http://dev.piwik.org/svn/trunk@5098 59fd770c-687e-43c8-a1e3-f5a4ff64c105

git-svn-id: http://dev.piwik.org/svn/trunk@5096 59fd770c-687e-43c8-a1e3-f5a4ff64c105