Infrastructure Cleanup Tasks 2011

From FedoraProject

(Difference between revisions)
Jump to: navigation, search
(Fix spelling, add wikimedia notes on uploads storage.)
Line 14: Line 14:
 
** Automated creation of new machines -- run one command and it's up
 
** Automated creation of new machines -- run one command and it's up
 
** puppet staging vs production
 
** puppet staging vs production
** glustrefs fedorapeople filesystem
 
** glustrefs fedorahosted filesystem
 
 
** Use yubikey for two-factor auth (instead of either or auth)
 
** Use yubikey for two-factor auth (instead of either or auth)
** Talk to mediawiki folks on how to run attachments to mediawiki so that we don't need a special machine
+
** glusterfs fedorapeople filesystem
 +
** glusterfs fedorahosted filesystem
 +
** Talk to mediawiki folks on how to run attachments to mediawiki so that we don't need a special machine (possibly glusterfs again?)
 
*** upload.wikimedia.org
 
*** upload.wikimedia.org
 +
*** http://wikitech.wikimedia.org/view/Media_server/2011_Media_Storage_plans
 +
*** http://wikitech.wikimedia.org/view/Media_server/Distributed_File_Storage_choices
 
** Split db to get fas to a different db server
 
** Split db to get fas to a different db server
 
** Replicate db so that we don't have a SPOF
 
** Replicate db so that we don't have a SPOF

Revision as of 19:08, 3 February 2011

Fix all the things that we have

    • Upgrade TurboGears1 apps to TurboGears2
      • Write automated tests using TG2's test framework
    • Fix the FAS authenticators to be less chatty
      • Put fas session information into memcached
    • Update FAS to have an admin console (no more direct db needs)
    • Update pkgdb to have an admin console (no more direct db needs)
    • Fix the Django auth providers to be faster
    • Move transifex to tx.net
    • Move blogs to wordpress.com
    • Move publictest to the cloud and create a sundown on them
    • Automated hosted projects
    • Automated build overrides
    • Automated creation of new machines -- run one command and it's up
    • puppet staging vs production
    • Use yubikey for two-factor auth (instead of either or auth)
    • glusterfs fedorapeople filesystem
    • glusterfs fedorahosted filesystem
    • Talk to mediawiki folks on how to run attachments to mediawiki so that we don't need a special machine (possibly glusterfs again?)
    • Split db to get fas to a different db server
    • Replicate db so that we don't have a SPOF
    • logging sucks
      • IPs hit proxies but we also need them to hit the app servers.
      • Fas needs to log more actions to its database
    • Do periodic reinstallations of guests (like app servers) so that we know there's nothing changed not in puppet.
    • fix backups
      • Make sure we're backing up everything
      • Stop backing up sysadmin data (/usr)
      • Reduce koji's resources
    • Finish and deploy coprs
    • go through list of rpm -Va on all hosts (in /var/tmp/global-rpm-va on puppet1) and make sure all the files there have counterparts in puppet to explain their changes

Done items

    • Upgrade quota to 2GB