Filter By Components

February 2017

Brief degradation on all services
A piece of hardware in Bitbucket's internal network infrastructure failed at roughly 17:38 UTC on Saturday 18th February 2017. Automated failover systems kicked in as intended, and performed as intended; the load balancers also began queueing connection requests (as intended) while the failover process completed. Unfortunately, all this intentional behavior led to an unintentional time of service degradation between (roughly) 17:38 and 17:45; load balancer backlogs caused many requests to wait far longer than anticipated, and some requests may have timed out as a result. We apologize for any inconvenience, and we're re-examining our failover strategy so that the backlog remains small when this happens next.
Feb 18
Customers are reporting intermittent SSH failures
Customers of Bitbucket attempting to use our SSH based service between roughly 12:11 PM to 12:59 PM UTC on February 10th may have experienced failures with the error message "Permission denied (publickey). fatal: Could not read from remote repository." Only a small percentage of overall customers would have experienced this problem. This was caused by one of our application servers responsible for our SSH service misbehaving. We have identified improvements to our load balancers that will prevent this situation from happening in the future.
Feb 10
Degraded performance on LFS
No more problems spotted with LFS; resolving incident.
Feb 10, 03:57-08:51 UTC
[Scheduled] Network maintenance; MTU/MSS changes coming
This maintenance is complete. Please contact our support team if you have any new or ongoing issues.
Feb 7, 00:00-01:52 UTC
Bitbucket Pipelines exits with a "no space left" message in some builds
This incident has been resolved.
Feb 6, 18:18-22:39 UTC

January 2017

Bitbucket Pipelines users may experience issues with private docker hub images
A permanent fix has been successfully deployed
Jan 25, 19:25-22:09 UTC
[Scheduled] Network maintenance; brief service interruptions possible
The scheduled maintenance has been completed.
Jan 15, 21:03-21:30 UTC
Bitbucket users may experience issues logging in after resetting their password
The issue has been resolved and all users who reset their password should be able to login.
Jan 12, 08:50-12:25 UTC
Pipelines not functioning.
The incident has been resolved. Commits that were pushed between 04:51 UTC - 05:42 UTC will have not created a Pipeline and will need to be triggered again with a new commit or a manual run.
Jan 5, 05:22-06:17 UTC

December 2016

We are seeing connection issues with gitweb/hgweb
Service has been restored.
Dec 1, 03:47-05:08 UTC

November 2016

Pipelines are currently failing without logs
All pipelines are starting normally. Any pipelines run between 0130 UTC - 0200 UTC will need to be rerun.
Nov 25, 01:34-02:33 UTC
Pipelines not running entire script
At 2:12AM UTC time, a mis-configured Docker agent image was propagated to our production cluster due to incorrect tagging. This caused builds to skip the clone step. We resolved the issue at 3:15 UTC time.
Nov 24, 03:29-06:20 UTC
Bitbucket authentication experiencing issues
After the rollback of Atlassian Accounts, engineers have not witnessed any issues with authentication by users after a final reset of their credentials. At this point we consider this incident resolved.
Nov 10, 16:20-18:04 UTC
[Scheduled] Bitbucket network maintenance
The scheduled maintenance has been completed.
Nov 7, 21:02 - Nov 8, 01:00 UTC
Pipelines allowance has not been reset for November
Issues with Pipelines allowance has been resolved.
Nov 2, 04:42-05:11 UTC

October 2016

Delayed task handling
This incident has been resolved.
Oct 28, 18:38-19:59 UTC
Bitbucket Pipelines is experiencing performance issues
This incident has been resolved
Oct 28, 07:13-12:16 UTC
git operations over HTTP/S were temporarily degraded
We have identified and fixed a problem with our load balancers that was affecting users attempting to use git via HTTP/S.
Oct 27, 07:58 UTC
Bitbucket services temporarily interrupted
This incident has been resolved.
Oct 26, 23:48 - Oct 27, 01:00 UTC
[Scheduled] Bitbucket webhooks database maintenance
Bitbucket webhooks database maintenance is complete.
Oct 25, 22:01-22:40 UTC
[Scheduled] Bitbucket storage maintenance
The scheduled maintenance has been completed.
Oct 23, 00:19-01:02 UTC
Bitbucket web and Webhooks "Internal Server Error" responses
This incident has been resolved.
Oct 20, 21:12-23:21 UTC
Sporadic connection timeouts on SSH and HTTPS pushes and pulls
Our rollback has resolved any lingering networking issues for end users. As always, please contact our support team if you're still experiencing problems.
Oct 19, 15:07-19:14 UTC
SSH unavailable
This incident has been resolved.
Oct 17, 14:31-16:21 UTC
Users pipelines are taking longer than usual to transition to In-Progress
Pipeline processing time has been confirmed to be normal.
Oct 7, 08:46-09:58 UTC
Pipelines failing, unable to pull docker images
Due to the recent outage at dockerhub; a majority of customers experienced failing pipelines when their docker images could not be retrieved.
Oct 3, 22:39 UTC

September 2016

Timeouts loading pipeline results page
This incident has been resolved.
Sep 30, 00:02-00:30 UTC
Bitbucket Pipelines outage
Creating statuspage incident to acknowledge an outage Bitbucket Pipelines that occurred at 2016-09-29 at 11:59 UTC, lasting approx 50 minutes.
Sep 29, 00:50 UTC
[Scheduled] Bitbucket firewall maintenance
The scheduled maintenance has been completed.
Sep 28, 23:03 - Sep 29, 00:00 UTC
Email Delays
Our email delivery provider reports that message delivery has been stable and delivered without delays. This incident is now resolved.
Sep 27, 15:23-18:11 UTC
Email Delays
Our email delivery provider reports that message delivery has been stable and delivered without delays. This incident is now resolved.
Sep 26, 16:18-17:33 UTC
API not responding
This incident has been resolved.
Sep 23, 21:28-22:50 UTC
[Scheduled] [Scheduled] Bitbucket AMQP Maintenance
Bitbucket AMQP cluster maintenance has been successfully completed
Sep 8, 22:01 - Sep 9, 00:35 UTC
Email delays
All messages appear to be getting to their destinations in an appropriate amount of time. As a result, we're going to resolve this incident. If you continue to experience unusual delays in emailed notifications from Bitbucket, then please open a support ticket (or check with your mail provider or administrator).
Sep 6, 17:37-22:57 UTC
Email delays again
Our email delivery provider reports that message delivery has been stable throughout the day. This incident is now resolved.
Sep 1, 18:26 - Sep 2, 20:23 UTC
Email delays
Our email provider reports that mail is being delivered in an appropriate amount of time. We're going to mark this as resolved, though we'll continue to keep an eye on things from our end.
Aug 31, 21:45 - Sep 1, 04:20 UTC

August 2016

Emails delayed
Bitbucket Cloud was not sending email notifications from Friday, August 26 at 2250 UTC to Monday, August 29 at 0720 UTC. We have corrected the problem and emails are being sent now.
Aug 29
Intermittent 500 errors on HTTP-based services
All services are back to normal performance. If you continue to experience unexpected errors, though, then please contact our support team.
Aug 26, 00:47-01:10 UTC
Webhooks delayed
We've finished processing the backlog of webhooks. All pending webhooks and Pipelines tasks should now be complete. If you're still seeing delays, then please contact our support team.
Aug 23, 13:09-15:42 UTC
[Scheduled] Network maintenance; brief service interruptions possible
The scheduled maintenance has been completed.
Aug 19, 00:05-03:01 UTC
Webhook deliveries delayed
The bug in the sender code has been patched, and webhooks continue to function properly, so we are closing this incident. Please contact our support team if you are still experiencing problems with webhooks.
Aug 18, 21:29 - Aug 19, 00:50 UTC
[Scheduled] Bitbucket Database Maintenance
Maintenance has completed successfully.
Aug 17, 20:00-20:17 UTC
intermittent webhooks delivery problems
This incident has been resolved.
Aug 6, 15:53-17:10 UTC

July 2016

Intermittent timeouts on the Bitbucket.org dashboard
This incident has been resolved.
Jul 8, 22:09 - Jul 9, 00:18 UTC

June 2016

Sporadic 500 errors, timeouts
Our workaround is holding, and traffic has returned to normal while we sort things out with the hardware vendor. If you are still experiencing problems then please contact our support team (https://support.atlassian.com or email support@bitbucket.org).
Jun 29, 19:02-21:32 UTC
Intermittent SSH authentication issues
Between roughly 07:30 and 08:30 UTC users may have experienced intermittent problems connecting to their repositories using SSH. We've repaired the application node responsible for the errors, and service has recovered.
Jun 21
[Scheduled] Bitbucket inbox maintenance
Inbox maintenance is complete. We've altered the retention time for comments, permissions changes, and other automated notifications to two weeks. Direct messages will stay in your inbox until you delete them.
Jun 16, 02:48-23:58 UTC
Unscheduled Maintenance Window
This incident has been resolved.
Jun 10, 19:08-21:27 UTC

May 2016

Bitbucket is unavailable for some users
This incident has been resolved.
May 24, 16:39-17:44 UTC
[Scheduled] Network maintenance; brief service interruption possible
The scheduled maintenance has been completed.
May 20, 01:00-02:00 UTC
A new version of Bitbucket has been deployed.
We have just deployed a new version of Bitbucket including several bug fixes and small improvements.
May 6, 21:49 UTC
Intermittent Failures
The backlog has been cleared. We will continue to monitor the situation closely.
May 6, 00:09-00:47 UTC

April 2016

Mail delayed
This incident has been resolved.
Apr 25, 19:07-21:36 UTC
Webhooks experiencing delays
Our webhooks service is fully back to normal and processing messages. The incident is resolved.
Apr 6, 12:21-13:08 UTC
Signups are currently not loading for users
We've fixed the faulty Javascript on the signup form, and everything looks good once more.
Apr 5, 22:24-23:51 UTC

March 2016

Slow page load times for users
Bitbucket.org and our API are now responding normally.
Mar 29, 14:46-15:54 UTC
[Scheduled] Network maintenance; no service interruption expected
The scheduled maintenance has been completed.
Mar 24, 19:53 UTC
Bitbucket is unavailable for some users
This incident has been resolved.
Mar 24, 17:41-18:30 UTC
CSS is occasionally not rendering for the Bitbucket website
This incident has been resolved.
Mar 23, 00:37-01:55 UTC
Bitbucket website is experiencing rendering issues.
Some users briefly experienced 500 errors on the Bitbucket.org website. This only affected the website. Git and Mercurial services were unaffected.
Mar 22, 23:06 UTC
Zero byte binary file download reports
We've identified the issue and all impacted users have been contacted.
Feb 29, 05:51 - Mar 1, 05:41 UTC

February 2016

Webhooks service upgrades
The webhooks upgrade is complete and the webhooks service has processed all queued messages. We're back to normal.
Feb 26, 21:21-21:30 UTC
Merge request workers running slow
This incident has been resolved.
Feb 23, 15:11-17:31 UTC
CDN serving incorrect file versions
All CDN boxes are serving correct JS files now. If you are still experiencing problems, then please contact our Support team.
Feb 17, 01:38-02:03 UTC
[Scheduled] Minor network maintenance; brief service interruption possible but unlikely
The scheduled maintenance has been completed.
Feb 16, 03:00-04:18 UTC
Some users are experiencing problems pushing to Bitbucket
Users should be able to push to Bitbucket successfully again. Sorry for the delay!
Feb 11, 16:42-16:45 UTC
Planned Maintenance is currently ongoing
We have resolved the networking problems uncovered in our planned maintenance. All services are now available.
Feb 10, 02:02-02:19 UTC
[Scheduled] Minor network maintenance; brief service interruption possible
The scheduled maintenance has been completed.
Feb 10, 01:43-02:00 UTC
Sign-ups are experiencing some problems
We've rolled a fix out and signups should be working normally. Thanks for your patience :)
Feb 9, 19:10-21:42 UTC

January 2016

Slow response times for Pull Requests
This incident has been resolved.
Jan 27, 14:23-15:39 UTC
Pull request workers running slow
This should be resolved now. Please email our support team (support@bitbucket.org) if you have any further issues.
Jan 25, 15:25-16:29 UTC
Sporadic gitweb slowness, 500 errors, timeouts
This incident has been resolved.
Jan 7, 10:56-15:41 UTC
[Scheduled] Minor network maintenance; brief service interruption possible
The scheduled maintenance has been completed.
Jan 6, 01:42-02:00 UTC
Sporadic gitweb slowness, 500 errors, timeouts
Users attempting to perform git operations over HTTPS between roughly 15:45 and 16:45 UTC may have experienced sporadic slowness, timeouts, or internal service errors. During that time, our servers were handling HTTP keepalives inappropriately on gitweb traffic, causing user connections to be queued improperly. We've resolved the issue, and traffic should be back to normal.
Jan 4
Webhooks event processing is delayed
This issue is now resolved and end users should no longer experience delays with webhooks events.
Jan 2, 02:30-03:33 UTC

December 2015

Delay in task handling
All delayed tasks in the backlog have been consumed and we expect no further delays on end user generated events.
Dec 15, 13:04-14:38 UTC
[Scheduled] Changing IP addresses; please update your firewall configs
The scheduled maintenance has been completed.
Dec 15, 00:00-01:00 UTC
New WebHooks unavailable while updating code.
Web hooks are again online. We will have to review why this deployment took so long. We will also take steps to ensure the deploys remain zero down-time similar to the main site.
Dec 12, 23:50 - Dec 13, 02:31 UTC
Network instability primarily affecting SSH
SSH throughput has been back to normal for some time with no further problems. The failed switch hardware has been removed from service.
Dec 8, 05:15-06:04 UTC
Background tasks running behind
This incident has been resolved.
Dec 2, 15:56-23:04 UTC
SSH, Git and Hg are not responding
This issue has been resolved.
Dec 2, 17:32-18:57 UTC

November 2015

Recent Activity Newsfeed Issues
This incident has been resolved.
Nov 20, 21:31 - Nov 21, 00:00 UTC
Degraded SSH Connection Performance
This issue has been resolved.
Nov 16, 16:31-17:22 UTC
Trouble rendering diffs
This incident has been resolved.
Nov 3, 13:31-14:48 UTC

October 2015

Pull Request, Webhooks, and other background tasks for Bitbucket may be delayed for some users at this time
All background tasks appear to be caught up. If you still have any issues with Webhooks, Pull Requests, or Newsfeeds, please let us know in support@bitbucket.org.
Oct 30, 13:47-17:48 UTC
Temporary database network issue
For a very brief moment, we experienced a networking issue with our primary database. This resulted in a cascade of 500 pages and errors for many users for about 2-3 minutes. This has been resolved.
Oct 27
Bitbucket is slow to respond
This incident has been resolved.
Oct 23, 10:55-16:39 UTC
Bitbucket Cloud intermittently responding to requests
It's been about nine and a half hours since we physically moved all remaining network devices to new hardware, and there have not been any new indications of trouble. All new hardware is functioning as expected, and all servers are communicating as normal. We're marking this as resolved; please contact our support team (support.atlassian.com) if you experience any new issues.
Oct 22, 15:19 - Oct 23, 04:25 UTC
More internal network excitement
Our routing changes held, and that network hardware handled normal traffic well throughout the day without trouble. We still have maintenance to perform in the coming days and weeks, but this immediate incident is resolved.
Oct 21, 11:04 - Oct 22, 05:55 UTC
Background tasks running behind
Bitbucket operations have returned to normal after restarting the message broker. We will continue to monitor the incident.
Oct 21, 15:08 - Oct 22, 03:11 UTC
Bitbucket website and API services are disrupted
We've identified and isolated some failing network hardware in our primary datacenter. All services have been restored to their normal condition.
Oct 20, 18:47 - Oct 21, 01:17 UTC
Bitbucket services are disrupted
Bitbucket services are operational. We will continue investigating the root cause of the previous instability.
Oct 15, 20:19-22:12 UTC
Git and Mercurial over HTTPS slow or not responding
Our Git and Mercurial HTTPS services had sporadic issues between roughly 02:00 and 03:00 UTC on 15 October 2015. During that time, users attempting to push, pull, or clone repos over HTTPS may have experienced very slow response times or timeouts. Pushes and pulls over SSH were unaffected, as were the GUI, the API, and source downloads. Upon investigation, we tracked the problem to a database server that handles authentication queries for the affected services. Once we failed those queries over to another server, normal service was restored.
Oct 15
Degraded WebHooks performance
This incident has been resolved
Oct 9, 15:36-18:40 UTC
[Scheduled] Network maintenance; brief outage expected
Network maintenance has been completed as planned, and all services are restored. Enjoy!
Oct 9, 00:00-00:24 UTC
Background tasks running behind
Queues are functioning normally and remain at healthy levels.
Oct 8, 17:41-20:49 UTC
Degraded database performance
All signs indicate that our steps to address the database performance issues earlier today were successful. The website and API remain at healthy performance levels and are behaving as expected.
Oct 7, 14:56-16:15 UTC
Users may experience login issues when using their email address to log in to Bitbucket
We have pushed out a fix for this problem. Users will no longer experience login issues when authenticating using their email address.
Oct 6, 23:01 - Oct 7, 00:13 UTC

September 2015

Degraded webhooks performance
The performance issues impacting our webhooks system have been resolved, and our queues remain at healthy levels. Webhooks are again functioning normally.
Sep 24, 14:14-16:56 UTC
SSH Service degraded
SSH connectivity has returned to normal. If you encounter any issues, please contact support@bitbucket.org for further assistance.
Sep 21, 16:24-17:32 UTC
SSH unavailable
This incident has been resolved.
Sep 4, 21:34-22:46 UTC
Background tasks running behind
This incident has been resolved.
Sep 2, 12:02 - Sep 3, 00:00 UTC
SSH / HTTPS service issue
SSH and HTTPS traffic is back to normal, though background tasks are still running.
Sep 2, 12:50-20:54 UTC
Background tasks running behind
Our background workers have finished working through their epic backlogs. All systems should be fully operational again.
Sep 1, 14:41-18:48 UTC

August 2015

Degraded database performance
Performance has been fully restored and services have been reported to be fully operational.
Aug 27, 14:48-17:47 UTC
Webhooks experiencing network issues
The networking issue affecting webhooks has been resolved. Webhooks should be firing as normal now.
Aug 26, 15:43-16:43 UTC
High load on front end systems
This incident has been resolved.
Aug 25, 14:51-18:24 UTC
Networking issue
This incident has been resolved.
Aug 12, 00:04-02:35 UTC
Database server hiccup caused 500 errors
A brief issue on our primary database server caused queries to back up. As a result, some users received a 500 or 503 error while attempting to connect. The issue has cleared, and traffic is flowing normally once more. We apologize for the inconvenience, and we'll continue to keep an eye on that particular host.
Aug 4, 23:30 UTC

July 2015

Sporadic API authentication issues
We've found and repaired the cause of the sporadic API auth issues. If you're still having trouble with API authentication or unusual basic-HTTP authentication requests, then please email support@bitbucket.org with details.
Jul 29, 00:20-01:35 UTC
Webhooks not sending
This incident has been resolved.
Jul 21, 14:31-15:28 UTC
Still some JS issues
All media has been rolled back, caches cleared, and CDNs purged. This event is now behind us.
Jul 1, 23:34 - Jul 2, 03:15 UTC
CSS and JS partially broken
This has been resolved and we are again properly service media assets.
Jul 1, 20:00-20:22 UTC

June 2015

SSH queueing temporarily maxed out
The SSH queue has remained stable through everybody's top-of-the-hour cron jobs, so we're marking this as "resolved".
Jun 12, 10:46-11:17 UTC
Degraded Site Accessibility
We've successfully deployed the latest changes; this incident has been resolved.
Jun 10, 04:55-07:05 UTC

May 2015

Gitweb 503s, load spike
This incident has been resolved.
May 27, 05:20-18:02 UTC
[Scheduled] Atlassian core network maintenance, 10 May 2015 02:00-07:00 UTC
The scheduled maintenance has been completed.
May 10, 02:00-07:00 UTC

April 2015

Intermittent HTTPS failures
From 17:45 until 02:45AM UTC users may have experienced intermittent HTTPS request failures. This was due to a misbehaving NGINX server that needed to be restarted. Unfortunately, the failure rate was sufficiently low to avoid escalation by our alerts but high enough that is may have led to problems using the service. We are adding more aggressive alerting to avoid future impacts in the event of a recurrence of this problem and will be evaluating the stability of our current NGNIX configuration in light of this incident.
Apr 13, 03:29 UTC
All systems fully operational*
Upstream network issues appear to be resolved. Please contact your ISP if you experience further issues.
Apr 3, 17:19-19:59 UTC

March 2015

[Scheduled] OpenSSL version upgrade
The scheduled maintenance has been completed.
Mar 19, 19:30-19:40 UTC
Javascript partially broken
This incident has been resolved.
Mar 17, 01:28-02:01 UTC
Maintenance on Front-end load balancers caused un-expected outage
Configuration corrected. Site is returned to normal.
Mar 3, 23:01-23:10 UTC
[Scheduled] Atlassian Core Network Maintenance 2/28 9pm UTC
The scheduled maintenance has been completed.
Feb 28, 21:01 - Mar 1, 03:00 UTC

February 2015

Post-upgrade cleanup
This incident has been resolved.
Feb 24, 04:27-23:35 UTC
[Scheduled] Emergency DB maintenance Feb-23 at 6pm PST
The scheduled maintenance has been completed.
Feb 24, 02:00-03:00 UTC
Experiencing high-load causing intermittent failures and slow response times.
The site has returned to normal. We will continue to monitor and look for root-cause.
Feb 23, 17:07-19:12 UTC
Intermittent site availability & slow page loads
The site has been returned to normal. We will continue to monitor and search for root cause.
Feb 20, 17:03-17:46 UTC
Web UI broken; will be fixed shortly
This incident has been resolved.
Feb 19, 22:23-22:52 UTC

January 2015

[Scheduled] Network Routing Maintenance 17-Jan-2015
The scheduled maintenance has been completed.
Jan 17, 03:00-09:01 UTC
DB reload/restart triggered at Jan.6 02:14 UTC
We inadvertently restarted our DB while making a minor configuration change. This caused a brief outage to our service. The service recovered within a few minutes and everything is back to normal. We are sorry for this interruption. Our processes will be updated to prevent this from happening again.
Jan 6, 18:31 UTC

December 2014

[Scheduled] Storage Systems Maintenance
The scheduled maintenance has been completed.
Dec 13, 16:00-19:00 UTC
[Scheduled] Atlassian Datacenters Network Maintenance Dec.6, 03:00 - 08:00 UTC
The scheduled maintenance has been completed.
Dec 6, 03:00-08:00 UTC

November 2014

CDN Outage
Our CDN has recovered fully from its earlier issue, and our website should be functioning normally again.
Nov 27, 00:56-02:35 UTC
SSH service issue affecting some customers
We have restarted some of the services and are no longer seeing the issue. We will continue to monitor and look for ways to make the SSH service more robust.
Nov 3, 13:42-18:45 UTC

October 2014

[Scheduled] Load balancer maintenance
The scheduled maintenance has been completed.
Oct 13, 02:46 UTC
[Scheduled] Load balancer maintenance
The scheduled maintenance has been completed.
Oct 13, 01:54-02:00 UTC
SSH backlog
An increase in SSH activity has created a backlog of SSH requests forcing some users to wait longer leading to possible timeouts. The system has been adjusted and the backlog cleared.
Oct 9, 15:20 UTC
DB Outage
We've managed to bring down the DB load, and services are now recovering. If you're experiencing any further issues, please contact support@bitbucket.org. Thanks for your patience!
Oct 1, 23:57 - Oct 2, 00:53 UTC

September 2014

SSH outage
This has been resolved
Sep 24, 15:53-15:56 UTC
Git and Mercurial unavailable over HTTPS.
All services restored.
Sep 17, 02:34-03:47 UTC
Problems serving static media
We have fixed the issues with serving static media (JavaScript and CSS). Please come to support if you encounter any other issues.
Sep 16, 22:36-22:56 UTC
Pull request listing temporarily unavailable
This incident has been resolved.
Sep 9, 22:03-22:11 UTC

August 2014

[Scheduled] Database Maintenance 2014-08-30 18:00 UTC, Duration: 2 hours
DB maintenance complete. Site returned to full operational status.
Aug 30, 18:00-19:31 UTC
Database high load and increased response times 2014-08-19 17:29 UTC
2014-08-19 17:29 -> 17:49 UTC We experienced high load on our back-end database which lead to longer than usual response times for our application. We are working with database consultants to analyze logs around that time to better understand the situation. The site has returned to normal.
Aug 20, 01:14 UTC
Intermittent site availability
Mitigation plan put into place. Site back to normal.
Aug 12, 17:27-18:04 UTC
[Scheduled] Network upgrade
Network maintenance completed.
Aug 10, 01:00-01:55 UTC

July 2014

[Scheduled] Network Maintenance 2014-07-29 22:00 UTC (brief outages expected)
The scheduled maintenance has been completed.
Jul 29, 22:00 - Jul 30, 00:00 UTC
Frequent Database problem causing site availability issues. 2014-07-30
We are experiencing frequent Database related problems that are causing our site to go down. We are taking corrective actions to bring the site back online each time. However, we know this is frustrating to our end-users. We will continue to keep an eye on the situation while we work to find the root cause. Thanks.
Jul 29, 08:20 UTC
High load on Database; site not serving pages at 2014-07-29 03:57 UTC
We were alerted by our monitoring scripts that our Database was experiencing high load and our site was down. We have restarted our Database and we are continuing to monitor the situation. The site is currently back online.
Jul 29, 05:09 UTC
High DB load & Site not responding at 2014-07-29 01:42 UTC
We were alerted by our monitoring scripts that our Database was experiencing high load and our site was down. We have restarted our Database and we are continuing to monitor the situation. The site is currently back online.
Jul 29, 05:06-05:06 UTC
Database server experiencing high load; site serving 500 pages. 2014-07-29 00:34
We were alerted by our monitoring scripts that our Database was experiencing high load and our site was down. We have restarted our Database and we are continuing to monitor the situation. The site is currently back online.
Jul 29, 01:16 UTC
[Scheduled] Datacenter cabling and networking maintenance 26-July-2014 4pm UTC
The scheduled maintenance has been completed.
Jul 26, 20:00-22:00 UTC
[Scheduled] Datacenter cabling and networking maintenance 26-July-2014 4pm UTC
The scheduled maintenance has been completed.
Jul 26, 16:00-20:00 UTC
Brief backend network outage 25/07/2014
This incident has been resolved.
Jul 25, 22:11-22:11 UTC
Source code downloads
We have resolved the issue with source downloads.
Jul 18, 07:37-08:10 UTC
Bitbucket website / SSH outage
This incident has been resolved.
Jul 16, 22:08-23:12 UTC

June 2014

Partial intermittent outage 15:30-18:05 PDT
We identified an issue with one of our application servers and have since corrected it. You may have experienced some intermittent errors with Git, Mercurial, and background tasks of the Bitbucket service from 15:30 to 18:05 PDT. We are sorry for any inconvenience.
Jun 20, 01:28 UTC
[Scheduled] Database Maintenance 6/14 10am PDT
The scheduled maintenance has been completed.
Jun 14, 17:00-20:14 UTC
[Scheduled] Emergency Database Maintenance
Maintenance is completed.
Jun 10, 23:00-23:13 UTC
Bitbucket site experiencing high load on DB server - Site not serving pages
Site is back online and has been stable for over 30 minutes. We will continue to monitor and look for a root cause. Then take steps to minimize the chance of a similar outage occurrence.
Jun 9, 21:50-22:42 UTC
Bitbucket.org unreachable
This incident has been resolved.
Jun 4, 00:23-01:03 UTC

May 2014

Network incident at our datacenter
This incident has been resolved.
May 31, 07:24-09:42 UTC
Intermittent 500 errors for anonymous requests
This incident has been resolved.
May 28, 23:45 UTC
Performance problems
Over the last few days we identified a series of performance problems related to the deployment of our new storage architecture. Since identifying the performance problems, we worked around the clock to correct the performance concerns. We have restored normal site, git, and mercurial performance. Once the dust settles, we will publish a more detailed report on what happened, changes that were made, and what we've done to avoid future incidents of this nature. We will continue to monitor the situation closely and will provide updates if anything changes. We apologize for any inconveniences this may have caused.
Apr 28, 11:09 - May 1, 22:10 UTC

April 2014

bitbucket.org unreachable
This incident has been resolved.
Apr 27, 13:17-15:49 UTC
Fixing SSL vulnerability
We have now completed the rebooting of our load balancers. Cheers.
Apr 8, 02:31-02:43 UTC

March 2014

[Scheduled] Database Maintenance
The scheduled maintenance has been completed.
Mar 22, 20:00-20:30 UTC
Unplanned outage
This incident has been resolved.
Mar 6, 14:33-17:41 UTC

February 2014

Unplanned outage
The site has been 100% restored to service. Please come to support with any other questions or issues.
Feb 23, 18:37-19:03 UTC
[Scheduled] Network Maintenance
The scheduled maintenance has been completed.
Feb 23, 05:15-05:28 UTC
[Scheduled] Network maintenance
The scheduled maintenance has been completed.
Feb 23, 04:00-05:00 UTC
Unplanned outage
The site has been 100% restored to service. Please come to support with any other questions or issues.
Feb 21, 19:27-19:46 UTC
Partial Git outage
Earlier today, during maintenance, a small number of repositories were temporarily taken offline. We have now restored access to these repositories. We apologize for any inconvenience this may have caused you and your team.
Feb 14, 03:19-09:32 UTC
[Scheduled] Scheduled Maintenance Saturday, February 8, 2014 at 18:00:00 UTC
The scheduled maintenance has been completed.
Feb 8, 18:00-20:11 UTC

January 2014

Unplanned outage
This incident has been resolved.
Jan 28, 04:58-16:19 UTC
Cloudfront Issue
CSS and JavaScript are now being served from CloudFront again. Changes we recently put in place to improve our SSL security inadvertently caused connectivity issues with CloudFront. To resolve the issue, we've enabled support for the SSL ciphers CloudFront requires.
Jan 27, 17:59-21:21 UTC
[Scheduled] Non-disruptive network maintenance
Maintenance completed successfully.
Jan 25, 21:52 UTC
Database Issue
This incident has been resolved.
Jan 16, 22:21 - Jan 17, 01:58 UTC
Performance problems
This incident has been resolved.
Jan 9, 13:34 - Jan 10, 01:28 UTC
Hook processing backup
We have experienced a minor backup in our processing of hooks. The source of the backup has been resolved and we are processing normally.
Jan 3, 19:45 UTC

December 2013

No incidents reported for this month.

November 2013

Unplanned outage
We have experienced a brief unplanned outage, all services are now restored and operational.
Nov 29, 16:23 UTC
Network issues
This incident has been resolved.
Nov 23, 09:08-09:24 UTC
Network issues
This incident has been resolved.
Nov 22, 10:12-16:57 UTC
Large asynchronous process queue backlog
Website performance has returned to normal. We have created a new queue to give website processes priority.
Nov 20, 21:52 - Nov 21, 00:16 UTC
Site performance problems
Site performance has returned to normal and we're now processing background tasks at a normal rate again.
Nov 20, 15:43-19:25 UTC
Partial system outage
The problem has been resolved and we are working on identifying and resolving the root cause.
Nov 19, 16:14-19:11 UTC
Large asynchronous process queue backlog
The queue backlog has been resolved
Nov 19, 00:41-00:56 UTC
Unplanned outage
The issue has been fully resolved. Some of our background tasks like Hooks and Issue Transitions may have failed during the outage. If your repository is in an inconsistent state or you have continued issues, please come to support and let us know.
Nov 15, 09:11-10:05 UTC
[Scheduled] Bitbucket will be performing non-disruptive maintenance
Maintenance completed successfully.
Nov 9, 18:00-20:32 UTC
[Scheduled] Bitbucket will be performing non-disruptive maintenance
We are done with our maintenance and all is well.
Nov 2, 16:00-21:03 UTC

October 2013

Pull request partial outage
Our queues have caught up and operations are back to normal. Please contact support if you are still seeing issues.
Oct 30, 16:01-17:21 UTC
Unplanned outage
All systems should be back to 100%. If you see anything else amiss, please let us know in support@bitbucket.org.
Oct 30, 13:58-14:56 UTC
[Scheduled] Bitbucket will be performing non-disruptive maintenance
We have successfully completed the upgrade.
Oct 12, 19:00-21:31 UTC
We had a brief issue with one of our SSH servers.
This incident has been resolved.
Oct 11, 18:52 UTC
Bitbucket has launched a new status site
We have launched a new status site that will allow you to track our uptime and our site performance. Enjoy
Oct 10, 23:25 UTC

September 2013

Source browser 404s
We're investigating some issues with the source browser resulting in 404s.
Sep 9

August 2013

Rogue system causing errors for some users
We have identified an issue with a rogue system causing errors for some users and are working to resolve it.
Aug 27
Problem with background tasks affecting pull request merges and imports
We identified an issue with our background tasks services and have restarted them. Pull Requests and other tasks such as imports should be normal and caught up. If you still see any issues, please let us know at support.atlassian.com.
Aug 26
DDoS attack service major service interruption
We have evidence this was a DDoS attack and are working on various mitigation steps.
Aug 3

July 2013

Load balancers causing website interrupted service
We're having an issue with our load balancers at the moment. We're working to resolve it asap.
Jul 22