Commit graph

340 commits

Author SHA1 Message Date
Daniel Grippi
c27d0b8780 Merge pull request #2281 from justindthomas/backup-postgres
backup task handles postgresql dumps
2011-11-29 14:09:51 -08:00
Justin Thomas
3e1561db24 moved pass_file deletion to postgres code block 2011-11-29 11:34:50 -08:00
danielgrippi
6f7c9e9301 Remove resque_rescheduler as it was killing our app servers (receiving
http requests).

Revert "retry less"

This reverts commit 7784156e3b.

Revert "supress resque retries"

This reverts commit 80cdcd4edd.

Revert "Retry federation if remote pod is down"

This reverts commit bcbc86e502.

Conflicts:

	app/models/jobs/http_multi.rb
2011-11-07 12:50:02 -08:00
Jonne Hass
a216252fe0 we cause too much load on travis: if you have a fork and use travis please turn it off; run oauth-cucumber inside other build to reduce builds and save (setup) time. 2011-11-07 01:38:22 +01:00
Sarah Mei
ac065e1706 Differentiate between oauth features and non-oauth features for travis. 2011-11-05 21:09:56 -07:00
Sarah Mei
a9ac7329d1 Add oauth features to travis as a separate build. Combinatoric explosion FTW 2011-11-05 20:40:16 -07:00
Sarah Mei
29f5ce1577 try breaking up travis build into components 2011-11-04 21:35:06 -07:00
Daniel Grippi
ed029b2fbd Merge pull request #2251 from manuels/retry_federations
Retry federation if remote pod is down
2011-11-02 14:09:30 -07:00
Justin Thomas
1b254ec2c5 removed legacy reference to a static path 2011-11-02 11:59:17 -07:00
Ilya Zhitomirskiy
22bf404344 saving instead of emailing retention stats 2011-11-02 10:15:40 -07:00
Justin Thomas
221f58378d removed overlooked static path 2011-11-01 22:14:14 -07:00
Justin Thomas
e50f0cfdb2 removed dependency on /tmp, improved retention period compliance, maintain legacy commands 2011-11-01 15:24:04 -07:00
danielgrippi
64c0591eac added first_name to csv task 2011-11-01 14:20:37 -07:00
danielgrippi
9de67aaee8 added rake task for generating a CSV of top actives from cohorts 2011-11-01 13:46:06 -07:00
Ilya Zhitomirskiy
c64588a68d adding attachments to all recepients 2011-10-31 18:09:43 -07:00
Ilya Zhitomirskiy
4be75a255f typo in the rake task 2011-10-31 18:09:43 -07:00
Ilya Zhitomirskiy
9cadb99f8a sending csv as a file 2011-10-31 16:39:09 -07:00
Justin Thomas
68d5f9d196 backup task handles postgresql dumps 2011-10-29 23:35:02 -07:00
Ilya Zhitomirskiy
03380516f1 actually delivering the emails 2011-10-26 17:26:02 -07:00
Ilya Zhitomirskiy
53b27a7627 added a rake task to email retention to admins 2011-10-26 16:35:20 -07:00
Manuel Schölling
bcbc86e502 Retry federation if remote pod is down 2011-10-27 00:36:55 +02:00
Ilya Zhitomirskiy
fd8476fe9c fixed clear cache rake task + puts 2011-10-05 12:09:42 -07:00
Ilya Zhitomirskiy
f4bfa22768 added a clear cache rake task, removed fake redis for mockredis, slight
refactor of the redis_cache class
2011-10-05 11:54:24 -07:00
Sarah Mei
18b1f360d8 Have our CI run only cucumber 2011-09-17 22:39:42 -07:00
danielgrippi
707118d8b5 default to postgres db in heroku rake task 2011-09-14 18:46:03 -07:00
danielgrippi
a99a174d5f alias jobs:work 2011-09-14 18:07:54 -07:00
danielgrippi
57079ef5cd set ENV['HEROKU'] explicitly in the heroku:config task 2011-09-14 18:05:40 -07:00
danielgrippi
ba63c028e6 added heroku gem, slugignore, and heroku rake task to load application.yml vars as config vars 2011-09-14 18:05:40 -07:00
danielgrippi
91e649977c MS DG update copyright 2011-09-14 11:23:12 -07:00
Jonne Hass
292b1e7465 small cleanup 2011-09-06 20:13:56 +02:00
Sarah Mei
ad009a71dc Don't run oauth.feature on travis, but run all features locally. 2011-09-04 11:27:30 -07:00
Sarah Mei
8d95684341 move jasmine before cucumber so we can fail faster on travis 2011-09-03 20:30:26 -07:00
Sarah Mei
4f11b75ed1 RAKE jasmine:ci. Duh. 2011-09-03 18:14:26 -07:00
Sarah Mei
45ffd99c11 Put a bit more messaging so we can see where the rspec double run is coming from. 2011-09-03 16:54:56 -07:00
Sarah Mei
984061cb80 Run spec, cucumber, and jasmine separately in an effort to not run rspec twice. 2011-09-03 16:38:16 -07:00
Sarah Mei
0a3f353f6a Run all specs on travis. Also, add 1.9.2 run. 2011-09-03 14:24:48 -07:00
Sarah Mei
14324aecc2 Install firefox on travis. Only run cucumber to save time while experimenting. 2011-09-03 14:10:06 -07:00
Sarah Mei
3fe6f47648 Add xvfb start to travis config. Use xvfb in specs. 2011-09-03 13:23:20 -07:00
Raphael Sofaer
2c65593579 Add quick option to mysqldump 2011-08-18 10:33:27 -07:00
Raphael Sofaer
f3932132d3 Let the next backup job overwrite the sqldump 2011-08-18 08:34:34 -07:00
Raphael Sofaer
abd5760569 Write, don't append backup 2011-08-12 13:32:14 -07:00
Maxwell Salzberg
e845bcf8e7 fix batch inviter 2011-08-08 19:18:25 -07:00
Maxwell Salzberg
f1a64c46f4 fixing the inviter 2011-08-08 19:07:38 -07:00
Raphael Sofaer
3f9954d18b Enable single-transaction mode in the backup script... that was a pretty dumb oversight. 2011-08-08 15:49:17 -07:00
Raphael Sofaer
3631178579 Add times to output of backup script, so we can correlate it with db slowdowns. 2011-08-08 14:58:10 -07:00
Raphael Sofaer
62d52f7db5 Nice tar in the mysql backup script as well 2011-08-08 14:48:35 -07:00
Raphael Sofaer
d517ce90fa Nice mysqldump in the backup script. 2011-08-08 14:47:22 -07:00
Raphael Sofaer
e366a4b8b5 re-enable the embedder feature outside of CI 2011-08-05 17:03:21 -07:00
Raphael Sofaer
f9f583058a Remove old seed scripts 2011-08-01 16:15:56 -07:00
Raphael Sofaer
3d88095ba2 Updating batch inviter 2011-08-01 14:49:21 -07:00
Raphael Sofaer
17774d8b3b Getting repost back to almost green. 2011-07-21 19:15:47 -07:00
Raphael Sofaer
70be713b15 Drop the integration databases in rebuild 2011-07-21 18:23:33 -07:00
Raphael Sofaer
e1a7ff798a Seed in rebuild 2011-07-09 16:55:05 -07:00
Raphael Sofaer
1d5b08aa92 Don't use the pretty formatter on CI 2011-07-06 10:09:58 -07:00
Raphael Sofaer
27f78dd1ad Rake cucumber should be pretty 2011-07-05 18:15:17 -07:00
Raphael Sofaer
53993cd714 Use schema:load on CI 2011-07-05 12:07:03 -07:00
Raphael Sofaer
5f592f9616 Schema:load in ci breaks it, because we would need to drop and re-create as well 2011-07-05 08:52:48 -07:00
Raphael Sofaer
e916cd5c2f Why migrate on CI? Schema load. 2011-07-04 22:12:05 -07:00
Raphael Sofaer
a36bd9897f Put the cruisecontrol stuff back in the cruise rake task, rather than a method. 2011-07-02 12:25:19 -07:00
Raphael Sofaer
7f55279962 I have no idea why travis ran the specs twice, but let's try again. 2011-07-02 10:21:30 -07:00
Raphael Sofaer
bc5d29bff3 Take some stuff out of the travis run, I think we need to use headless instead of an explicit xvfb. Turning off travis for now. 2011-07-02 10:21:30 -07:00
Raphael Sofaer
de8e750b0d Put it all in the travis yml file 2011-07-02 00:56:27 -07:00
Raphael Sofaer
3baf433b3a More travis stuff 2011-07-02 00:50:11 -07:00
Raphael Sofaer
d1a149f9f6 Some stuff to not need an application.yml in CI 2011-06-29 11:52:13 -07:00
cyberkov
94b152e733 fixed whitespace task mentioned in bug 1041 2011-06-15 13:48:40 +02:00
Raphael Sofaer
c78e903794 Change rebuild back to using migrate 2011-06-09 15:30:58 -07:00
danielgrippi
d7efee55a1 load schema instead of migrating on rake db:rebuild 2011-06-06 19:39:14 -07:00
danielgrippi
bd8ea324ae remove unused rake task 2011-06-06 19:37:51 -07:00
Raphael Sofaer
5455aedf1d Compress the database dump during backup 2011-06-01 10:56:12 -07:00
Raphael Sofaer
b3cbe0a3a5 Wrap integration rake in MissingSourceFile rescue to avoid failure when the test gems aren't present. 2011-06-01 10:25:19 -07:00
Sarah Mei
8de71d41e4 Don't need to export the selenium server port anymore on CI. Yay! 2011-05-28 22:22:06 -07:00
Sarah Mei
f732d20f0c Remove vendored jasmine; use normal jasmine gem. thx @tubbo for the prompt. 2011-05-28 21:03:39 -07:00
Raphael Sofaer
38289b1a47 Multi-server integration tests are now possible 2011-05-25 15:16:14 -07:00
Raphael Sofaer
70fd2e916a Update rspec 2011-05-13 17:52:37 -07:00
Raphael Sofaer
8af6fab0a4 Move rspec rake stuff into loaderror begin-rescue so that we can deploy with --without test 2011-04-06 14:44:04 -07:00
Raphael Sofaer
847a66735a Increase time between thin restarts, rescue jasmine load failure for deploying without test gems 2011-04-06 14:32:46 -07:00
zhitomirskiyi
70d71ec491 service users is green 2011-03-21 14:56:50 -07:00
Raphael Sofaer
4b4654a408 Changing message to text, partway done, deleted data conversion 2011-03-14 11:39:31 -07:00
danielgrippi
1f5edb1d92 Merge branch 'private_messages'
Conflicts:
	app/controllers/status_messages_controller.rb
	app/models/data_point.rb
	app/models/status_message.rb
	db/schema.rb
	lib/fake.rb
	public/stylesheets/sass/application.sass
	spec/models/mention_spec.rb
2011-03-08 21:23:41 -08:00
zhitomirskiyi
9d7611f8d8 addedthe controllers and the views for the message and the conversation inbox, going to pull in some left nav styling 2011-03-02 12:27:57 -08:00
Raphael Sofaer
68f0f7ec21 Add rcov task 2011-03-01 18:12:42 -08:00
Raphael Sofaer
0cb218bba0 Delete statistic and data point models 2011-03-01 16:54:12 -08:00
maxwell
7ace73b84b iz ms wip fixing contactController destroy 2011-02-17 18:05:21 -08:00
Sarah Mei
84d596ee47 Clean up the public/uploads folder after ci runs. 2011-02-12 09:16:12 -08:00
maxwell
84325edeb8 Revert "added prune method"
This reverts commit 7078937311.
2011-02-03 15:10:54 -08:00
maxwell
7078937311 added prune method 2011-02-03 14:47:04 -08:00
maxwell
7bfaf462c8 zomg actually set the db and use it 2011-02-02 15:33:19 -08:00
maxwell
450696fa60 added db to variables 2011-02-02 15:31:55 -08:00
maxwell
228c1a85e8 add equals 2011-02-02 15:12:51 -08:00
maxwell
f97c4ae5c9 adding loading of user and password from database.yml 2011-02-02 15:09:19 -08:00
maxwell
94135827ce add mysql dump cron and task 2011-02-02 14:55:13 -08:00
Sarah Mei
9a6fca87ff Re-enable running a single cucumber feature on the command line 2011-02-02 11:13:59 -08:00
Sarah Mei
0b39359d1c Standardize how we're requiring config/environment 2011-01-23 12:42:09 -08:00
Sarah Mei
225e5fc9d7 This much untested code makes me sad. But I fixed the bug whereby no rake tasks worked because of the require line. 2011-01-21 22:03:21 -08:00
zhitomirskiyi
f89c442730 statistics class does distributions and averages on its DataPoints 2011-01-21 10:29:07 -08:00
zhitomirskiyi
55bfbfd5b0 added users_with_posts_today to DataPoint 2011-01-21 10:29:07 -08:00
zhitomirskiyi
0dc0af015f added methods to statistics rake task 2011-01-21 10:29:06 -08:00
zhitomirskiyi
1d228fa819 stats rake file now works with mysql; production 2011-01-19 17:04:46 -08:00
maxwell
465dd9ba96 check to see if rails is already loaded in a couple of places 2011-01-19 13:30:12 -08:00
zhitomirskiyi
86c2686b9a a little begin rescue magic for uploading to s3 2011-01-17 15:56:06 -08:00
zhitomirskiyi
47671ac332 no pod_url 2011-01-17 15:56:06 -08:00
zhitomirskiyi
0c8aca3ef8 rebasing 2011-01-17 15:56:06 -08:00
zhitomirskiyi
0f9dc4954a added a task to upload 2011-01-17 15:56:06 -08:00
danielvincent
7477a22421 safeguard on absolutify rake task 2011-01-17 15:56:06 -08:00
danielvincent
7f87825186 fixed nil error in migration when dealing with remote images 2011-01-17 15:56:06 -08:00
danielvincent
1d52e06532 added rake task and spec for absolutifying existing image links 2011-01-17 15:56:06 -08:00
Sarah Mei
bb04224187 Add db:migrate to cruise task for mysql branch 2011-01-15 19:39:01 -08:00
Raphael
738e8c65c8 Merge almost complete, 4 failures 2011-01-14 16:00:10 -08:00
Raphael
8f91689b3f Require config environment rather than the environment rake task 2011-01-14 10:48:01 -08:00
zhitomirskiyi
54d4f4350d one event 2011-01-13 15:11:00 -08:00
zhitomirskiyi
9e332a6188 comma 2011-01-13 14:40:48 -08:00
zhitomirskiyi
97e5c3cb2c typo 2011-01-13 13:36:03 -08:00
zhitomirskiyi
99931cdf41 splunking some stats 2011-01-13 12:54:18 -08:00
Raphael
f8be5a284c Don't use the environment rake task, just require the environment 2011-01-11 11:05:21 -08:00
Raphael
6ba587155a explicit require in rake file 2011-01-10 18:48:12 -08:00
Raphael
b9afd6012c export should require environment 2011-01-10 18:45:02 -08:00
Raphael
0b265012bc Make task for full migration 2011-01-10 18:42:34 -08:00
zhitomirskiyi
868cb1efc1 checking that filepath exists 2011-01-07 10:57:37 -08:00
zhitomirskiyi
c8e161f1cf photo backups are now in 4.5 gb chunks 2011-01-07 09:37:45 -08:00
Raphael
7c3c17a418 Move fantasy_resque to the fake_resque file, add services to the mysql export fixture 2011-01-06 16:34:28 -08:00
Raphael
9ba43b148f Move resque modifications out to spec/support 2011-01-06 12:33:12 -08:00
Raphael
8d62ad8896 Add some reloads 2011-01-06 12:33:12 -08:00
Raphael
0284f0fd6d Write fixture for mysql export 2011-01-06 12:33:12 -08:00
Sarah Mei
75ac7e91c8 Refactor ImportToMysql; add import_raw. Add rake task for import.
Remove unique constraint on index on mongo_requests.
2011-01-05 23:54:22 -08:00
Sarah Mei
7453130c63 Namespacin'. 2011-01-04 20:12:11 -08:00
Sarah Mei
a4c01e4df1 More logging (w/ elapsed time) on mysql export. 2011-01-04 19:40:15 -08:00
Raphael
adb238c7d1 Merge remote branch 'tomk/717-rake-statistics' 2011-01-04 16:13:28 -08:00
Raphael
c643346589 Making it easier to maybe put .inspect on all the accesses to the json export 2011-01-04 14:25:40 -08:00
Raphael
0966889ab9 continue work on mongo export 2011-01-04 10:58:22 -08:00
Philip Champon
607fea6722 Handling bug http://bugs.joindiaspora.com/issues/767
Added email argument to task, warn and replace if address resolves to
an invalid user@domain one.
2010-12-31 14:53:32 +01:00
zhitomirskiyi
9f227b3b0a manual logging in the backup, since Rails.logger is nil 2010-12-30 14:27:35 -08:00
Thomas R. Koll
be270c4696 Adding rake statistics:genders to list all genders with profile count 2010-12-30 14:18:12 +01:00
Thomas R. Koll
61d0f0ea65 Feature #717: Adding rake tasks to print statistics on users and content
Adds following rake tasks:
  rake statistics:users
  rake statistics:content
2010-12-30 13:38:26 +01:00
Raphael
4e44b197c2 Begin writing migration from mongo to mysql 2010-12-29 18:15:13 -08:00
Alec Leamas
8d218e7871 suburi cucumber test.
Adds the features/uri-features test directory, testing sub-uri
deployment. These tests uses script/server since much of this code is
about configuring the server.  They are not run by "rake cucumber", to
run them use "bundle exec rake cucumber features/uri-test".

Tests requires a working app_config.yml setup with pod_url =
"http://localhost:3000/diaspora"

Patches cucumber.yml to always load step definitions from features/**, see
http://thoughtsincomputation.com/posts/cucumber-step-definitions-and-autorequire-hell
2010-12-29 10:31:25 +01:00
Raphael
b642cd6840 Merging master into mysql 2010-12-26 16:30:17 -08:00
Sarah Mei
a13136a4dc Clean up first_user rake tasks; create add_user rake task 2010-12-24 13:46:25 -08:00
Sarah Mei
1f67cc2485 Replace APP_CONFIG with lib/app_config.rb so that it's testable. 2010-12-24 12:31:09 -08:00
Sarah Mei
aeaabd29f1 run specs before cucumber in default rake task 2010-12-24 10:41:20 -08:00
Raphael
319452537e Below 70 failures, GUIDs are next 2010-12-21 15:46:15 -08:00
Raphael
d44e76a6aa Down to 250 failures in mysql 2010-12-20 00:36:48 -08:00
Mike Sofaer, Raphael Sofaer & Sarah Mei
58f757b91d profile_spec is passing with mysql... baby steps. 2010-12-18 18:45:55 -08:00
danielvincent
9ef9b3f0c3 log backup rake tasks 2010-12-17 12:26:20 -08:00
Raphael
94fe0b4049 Do the update in JS 2010-12-14 21:54:18 -08:00
Raphael
bc35388d1f Use find_each 2010-12-14 20:58:22 -08:00
zhitomirskiyi
1d1faea9e7 tiny typo 2010-12-14 19:50:22 -08:00
danielvincent
2cf332e120 Remove sent boolean from requests, finish migration 2010-12-14 19:27:18 -08:00
danielvincent
f1ee32145d Remove pending_requests from user, just use Request.from and Request.to. 2010-12-14 19:00:03 -08:00
maxwell
0119de4afc adding task to fix users with periods 2010-12-14 18:45:10 -08:00
maxwell
6bd42874e8 adding a task to fix person object with spaces in their name 2010-12-14 17:36:27 -08:00