official typo3.org infrastructure &the typo3 server admin team
DESCRIPTION
slides in english - Talk at the TYPO3camp Rhein-Ruhr Essen, Germany, 09.-11.11.2012TRANSCRIPT
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Die offizielle typo3.org Infrastruktur &
das TYPO3 Server Admin Team
[slides in english]
Official typo3.org infrastructure &the TYPO3 Server Admin Team
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Your Presenter
Hi,
I’m Steffen!
Please give me feedbackabout this presentation!
@StGebert on Twitter
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
I live in Würzburg
Studied Computer science there
Photo by Juergen Mangelsdorf (CC)http://www.flickr.com/photos/22084572@N07/2217991811/
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Day-to-day Job
Now PhD student and researcher
• Future Internet research
Photo by Paul Soler-Moya (CC)http://www.flickr.com/photos/40351463@N00/3927504524/
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
TYPO3 Core Team Member
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
TYPO3.org Server Admin Team Member
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Our Team
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
The team
Christian Trabold Fabien Udriot
Michael Stucki (Leader)
Steffen GebertPeter
Niederlag
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Contacting the Team
• [email protected] (handled through OTRS)
• Forge projects (Other > Server Team)http://forge.typo3.org/projects/team-server-public
• Team-Page on typo3.orghttp://typo3.org/teams/server-team/
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Responsibilities & Working Mode
• Maintenance of the official server infrastructure
• Not: Maintaining all the web sites (*)
• But, of course, we maintain also web sites
• Bi-weekly Skype-Meetings (Tuesdays 8:00 am)
• Private Mailing list
* my definition!
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Public Sites and Services
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
wiki.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
lists.typo3.org
everybody subscribed?
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
lists.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
bugs.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
forge.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
forge.typo3.org
• Collaboration platform
• Project hosting for Core and Extensions
• Issue Tracker
• Wiki
• Connection to Version Control Systems (SVN/Git)
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
forge.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
bigbluebutton.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
api.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
notes.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
ci.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
metrics.typo3.org
• Code Metrics for Core and Extensions
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
translation.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
translation.typo3.org (2)
• suggestions for translations
• approval by team members
• more improvements upcoming
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
svn.typo3.org
• SVN Version Control System - svn://svn.typo3.org
• Used by 2043 extensions
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
git.typo3.org
• Git Version Control System - git://git.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
review.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
review.typo3.org
• Review process prior to merge
• Used for TYPO3 CMS Core, Flow, Neos, couple of Extensions
• Transparent development
• Everybody allowed to push new patches
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
get.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
(government.v4.)demo.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
status.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
forum.typo3.org
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
forum.typo3.org
Caution: Work in progress!
http://forum.typo3.org
User: t3crrPassword: unperfekt
Please test it!Report bugs to http://forge.typo3.org/projects/show/team-forum(Others > Server Team > forum.typo3.org)
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Behind the Scenes
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Infrastructure
• 100% sponsored
• Five servers
• Debian Linux
• OpenVZ virtualization
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
typo3.org
• Relaunched in April 2012
• Split into 5 VMs
• Proxy (running nginx)
• Web (running varnish, Apache, PHP)
• MySQL
• SOLR
• Jenkins
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Single Sign-On
• One password to rule them all
• Based on DirectSSO (single-signon.com)
• Authentication against fe_users
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Zabbix Monitoring
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Zabbix Monitoring
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef
• Configuration Management Software
• “Infrastructure as Code”
• Configuration is under version control
• Packaged into “Cookbooks” containing “Recipes”
• Chef-Server as central hub
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef: Cookbooks
• Dependencies between cookbooks
• e.g. TYPO3 cookbook uses Apache2 cookbook to create vHosts
• Notification triggers actions(config file changes -> service restarts)
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef: Architecture
• Chef-client runs on every server
• Communicate with our Chef-Server
• Client registers once at the Chef-Server
• Authenticated data exchange (through certificates)
• Chef-Client retrieves roles, cookbooks and attributes
• Chef-Client executes the Ruby code and configures the Linux system
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef: Attributes
• Per-host attributes are saved in Chef Server
• Examples for attributes
• Host name for Apache vHost
• Datacenter-specific smarthost for postfix
• Password of the MySQL user
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef: Resources
Example: MySQL cookbook / Server recipe
• Install the Package
• Deploy the config file my.cnf
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef: Resources
Example: MySQL cookbook / Server recipe
• Define the service mysql
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef & Vagrant
• Vagrant provides API for VirtualBox
• `vagrant up` creates/starts VM
• Configures the VM as defined in Chef
• Great combination!
• Example
• git://git.typo3.org/Teams/Server/Vagrant/Typo3Org.git
• typo3.org in a box (or two..)
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Chef: Cookbook Sharing
• Healthy community writing cookbooks
• Our cookbooks open-sourcedhttp://github.com/typo3-cookbooks
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
The Future
TYPO3camp Rhein-RuhrEssen, 9. - 11.11.2012
Future plans 2012
• Software upgrades of forge.typo3.org and review.typo3.org
• Central message queue
• Self-provisioned Git support for community extensions
• Centralized Syslog-Server based on Logstash, Greylog2 & Kibana(see Christian Trabold’s T3CON12-ASIA presentation)
• Improve Chef coverage
• Debian Wheezy updates
• Year 202x
• LDAP... would be nice..
contributions welcome!