tag:status.chargebee.com,2005:/historyChargebee Status - Incident History2024-03-28T18:40:03ZChargebeetag:status.chargebee.com,2005:Incident/203278422024-04-07T04:30:00Z2024-03-22T12:20:52ZScheduled Maintenance Of Production Database<p><strong>THIS IS A SCHEDULED EVENT Apr <var data-var='date'>7</var>, <var data-var='time'>04:30</var> - <var data-var='time'>09:30</var> UTC</strong></p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>12:20</var> UTC</small><br><strong>Scheduled</strong> - On April 06th and 07th, 2024 between 4:30 and 9:30 am UTC, we will be performing improvements to our production database.<br /><br />Impact: GET & POST operations for Product Catalog 2.0 merchants will be temporarily unavailable during this maintenance window. Additionally, intermittent checkout failures may occur for transactions using the Chargebee Gateway. However, the downtime for each merchant is expected to be minimal, lasting at most 10 minutes.<br /><br />We apologize for any inconvenience this may cause and appreciate your patience and understanding as we work to enhance our services. Operations will return to normal promptly outside of the maintenance period.</p>tag:status.chargebee.com,2005:Incident/203278242024-04-06T04:30:00Z2024-03-22T12:18:56ZScheduled Maintenance Of Production Database<p><strong>THIS IS A SCHEDULED EVENT Apr <var data-var='date'>6</var>, <var data-var='time'>04:30</var> - <var data-var='time'>09:30</var> UTC</strong></p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>12:18</var> UTC</small><br><strong>Scheduled</strong> - On April 06th and 07th, 2024 between 4:30 and 9:30 am UTC, we will be performing improvements to our production database.<br /><br />Impact: GET & POST operations for Product Catalog 2.0 merchants will be temporarily unavailable during this maintenance window. Additionally, intermittent checkout failures may occur for transactions using the Chargebee Gateway. However, the downtime for each merchant is expected to be minimal, lasting at most 10 minutes.<br /><br />We apologize for any inconvenience this may cause and appreciate your patience and understanding as we work to enhance our services. Operations will return to normal promptly outside of the maintenance period.</p>tag:status.chargebee.com,2005:Incident/203481312024-03-25T03:00:29Z2024-03-25T06:46:47ZAvalara Service Degradation<p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>03:00</var> UTC</small><br><strong>Resolved</strong> - On March 25, 2024, between 1:18 and 1:19 UTC, Avalara encountered internal server errors affecting specific merchants. Investigation revealed the root cause to be related to a third-party service provider utilized by Avalara. The errors have since subsided, with no further impact reported.</p>tag:status.chargebee.com,2005:Incident/203257622024-03-21T11:39:51Z2024-03-22T07:23:22ZMissing Subscription Cancellation Option in Product Catalog 2.0 Customers<p><small>Mar <var data-var='date'>21</var>, <var data-var='time'>11:39</var> UTC</small><br><strong>Resolved</strong> - On March 21st, 2024, during our efforts to enhance user interface scalability, a deployment resulted in removing the subscription cancellation option from all test sites. Promptly recognizing the issue, our team took swift corrective measures, reverting the change to restore functionality. We apologize for any inconvenience caused and appreciate your patience as we work to resolve this disruption.</p>tag:status.chargebee.com,2005:Incident/203086852024-03-20T09:36:47Z2024-03-22T07:22:56ZPC2.0 Subscription UI Loading Issue<p><small>Mar <var data-var='date'>20</var>, <var data-var='time'>09:36</var> UTC</small><br><strong>Resolved</strong> - Between 08:31 am and 09:00 am UTC, some test sites experienced intermittent loading issues with the subscription page. A recent change in our platform caused this disruption. Our team swiftly identified the problem and took immediate action to minimize its impact. We have successfully resolved the issue by reverting the change. We apologize for any inconvenience and disruption to your service during this time.<br /><br />Note - Only the user interface was impacted by this incident; the API remained unaffected.</p>tag:status.chargebee.com,2005:Incident/203074102024-03-20T05:57:07Z2024-03-20T05:57:20ZAvalara Service Degradation (Test Sites)<p><small>Mar <var data-var='date'>20</var>, <var data-var='time'>05:57</var> UTC</small><br><strong>Resolved</strong> - Between 04:54 and 05:03 UTC, Avalara experienced internal server errors impacting certain merchants. The root cause has been identified as stemming from a third-party service provider, Avalara. The errors have ceased, and there are no ongoing impacts as of 5:03:00 AM UTC. <br /><br />This incident exclusively pertained to the TEST site; no LIVE sites were affected during the specified timeframe.</p>tag:status.chargebee.com,2005:Incident/202989332024-03-19T08:15:40Z2024-03-19T08:15:45ZFailures Noticed in GET API Requests.<p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>08:15</var> UTC</small><br><strong>Resolved</strong> - On 19-Mar-2024 between 04:10 and 05:08 UTC, some customers experienced failures in GET operations due to internal service issues. Our engineering team promptly identified and resolved the issue, restoring services to normal. We sincerely apologize for any inconvenience this may have caused to our customers. <br /><br />It's important to note that this incident solely impacted GET operations; POST operations remained unaffected.</p>tag:status.chargebee.com,2005:Incident/201662972024-03-17T19:00:56Z2024-03-17T19:00:56ZDatabase Maintenance Activity - Receivables<p><small>Mar <var data-var='date'>17</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>17</var>, <var data-var='time'>17:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 5</var>, <var data-var='time'>13:10</var> UTC</small><br><strong>Scheduled</strong> - Chargebee will perform scheduled database maintenance for Receivable services between <br />Mar 17, 2024 17:00 and Mar 17, 2024 19:00 UTC.<br /><br />During this maintenance window, our Receivable database will undergo essential maintenance to enhance its performance and scalability. As a result, there will be a brief downtime of less than 20 minutes for all read & write operations.<br /><br />We apologize for any inconvenience this may cause and appreciate your patience and understanding during this maintenance activity.</p>tag:status.chargebee.com,2005:Incident/202265252024-03-12T16:36:51Z2024-03-12T16:36:51ZHubSpot Service Degradation<p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>16:36</var> UTC</small><br><strong>Resolved</strong> - HubSpot is now working for all users. They have identified and addressed the root cause of the issue that prevented HubSpot from loading, and the issue is fully resolved.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>16:32</var> UTC</small><br><strong>Identified</strong> - Hubspot is addressing the issue that prevented HubSpot from loading beginning at 11:33 AM EDT (UTC -04:00) on Mar 12, 2024. They are monitoring performance closely to ensure the software recovers properly.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>16:27</var> UTC</small><br><strong>Investigating</strong> - Our team has identified a major outage with the HubSpot integration since 15:40 UTC. HubSpot's technical team is working on service restoration.<br />Real-time updates on the outage status can be found here: https://status.hubspot.com/incidents/590gy6mpxjhk</p>tag:status.chargebee.com,2005:Incident/202116782024-03-11T06:01:37Z2024-03-11T07:37:01ZChargebee Merchant Portal Access Issues<p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>06:01</var> UTC</small><br><strong>Resolved</strong> - We faced internal service issues which caused problems for some customers who were trying to access the Chargebee Merchant Portal. Our engineers have identified and fixed the issue, and the services are now fully operational. Our team is closely monitoring the situation to ensure that everything is running smoothly. If you are still experiencing any issues, please don't hesitate to contact our support team for assistance. <br /><br />We apologize for any inconvenience or disruption.<br /><br />Note: There were no API impacts, only the user interface was affected by the impact.</p>tag:status.chargebee.com,2005:Incident/201738102024-03-06T08:25:10Z2024-03-07T08:24:46ZSubscription Schedule Changes Functionality Issue<p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>08:25</var> UTC</small><br><strong>Resolved</strong> - Recently, our subscription_scheduled_changes feature encountered failures, preventing customers from scheduling changes to their subscriptions when contract terms are enabled. This issue stemmed from a recent code update. Remedial steps have been taken to address the bug and the issue is fixed, and we apologize for any inconvenience caused.</p>tag:status.chargebee.com,2005:Incident/199814732024-03-03T09:30:57Z2024-03-03T09:30:57ZScheduled Maintenance Notification<p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>09:30</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>04:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>07:09</var> UTC</small><br><strong>Scheduled</strong> - We are committed to providing you with the best possible service and continuously improving our systems to meet your needs. To ensure the highest levels of performance and reliability, we have scheduled system maintenance on the following dates.<br /><br />Maintenance Window: Mar 03rd,2024 between 04:30 UTC to 09:30 UTC<br /><br />While we have scheduled maintenance on the above-mentioned dates, please be assured that any actual downtime will be extremely brief, not exceeding 5 minutes for each merchant. The activity may occur at any point during the mentioned windows, but outside of these instances, your systems will remain fully operational. During those 5 minutes, you may experience elevated error rates (5xx responses) for POST operations.<br /><br />Thank you for your continued trust and understanding.</p>tag:status.chargebee.com,2005:Incident/199814722024-03-02T09:30:56Z2024-03-02T09:30:56ZScheduled Maintenance Notification<p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>09:30</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 2</var>, <var data-var='time'>04:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>07:09</var> UTC</small><br><strong>Scheduled</strong> - We are committed to providing you with the best possible service and continuously improving our systems to meet your needs. To ensure the highest levels of performance and reliability, we have scheduled system maintenance on the following dates.<br /><br />Maintenance Window:Mar 02nd between 04:30 UTC to 09:30 UTC<br /><br />While we have scheduled maintenance on the above-mentioned dates, please be assured that any actual downtime will be extremely brief, not exceeding 5 minutes for each merchant. The activity may occur at any point during the mentioned windows, but outside of these instances, your systems will remain fully operational. During those 5 minutes, you may experience elevated error rates (5xx responses) for POST operations.<br /><br />Thank you for your continued trust and understanding.</p>tag:status.chargebee.com,2005:Incident/201573172024-03-01T20:16:29Z2024-03-04T14:03:41ZChargebee RevRec Portal Login Issues<p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>20:16</var> UTC</small><br><strong>Resolved</strong> - We experienced issues with our internal service due to which customers faced issues while logging in to Chargebee RevRec Portal. Our engineers have identified and fixed the issue. The services are back to normal. Our team is closely monitoring this case. Please reach out to our support team in case you are still facing issues.<br /><br />We apologize for any inconvenience or disruption.</p>tag:status.chargebee.com,2005:Incident/201281082024-03-01T15:39:04Z2024-03-01T16:10:57ZService Interruption in the GoCardless Gateway<p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>15:39</var> UTC</small><br><strong>Resolved</strong> - A recent change in our application led to failures in processing collect-invoice and sub-renewal requests via the GoCardless gateway. This was due to incomplete error handling, resulting in null pointer exceptions. We fixed this by addressing how we handle these errors, ensuring transactions can now fail gracefully. We apologize for any inconvenience this may have caused.<br /><br />Note – The impact was very minimal as only a few transactions failed. We handled them well during the impacted timeframe with no further impact from the incident.</p><p><small>Mar <var data-var='date'> 1</var>, <var data-var='time'>10:42</var> UTC</small><br><strong>Identified</strong> - We discovered an issue, where Go-cardless customers are experiencing disruptions in their payment processes due to a technical error affecting collect-invoice and sub-renewal requests. Our team is actively investigating the issue and working on a resolution. We apologize for any inconvenience caused and appreciate your patience as we work to resolve this issue promptly.</p>tag:status.chargebee.com,2005:Incident/199814692024-02-25T08:38:34Z2024-02-29T08:10:35ZScheduled Maintenance Notification<p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>08:38</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>25</var>, <var data-var='time'>04:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>14</var>, <var data-var='time'>07:08</var> UTC</small><br><strong>Scheduled</strong> - We are committed to providing you with the best possible service and continuously improving our systems to meet your needs. To ensure the highest levels of performance and reliability, we have scheduled system maintenance on the following dates.<br /><br />Maintenance Window:Feb 25th, 2024 between 04:30 UTC to 09:30 UTC<br /><br />While we have scheduled maintenance on the above-mentioned dates, please be assured that any actual downtime will be extremely brief, not exceeding 5 minutes for each merchant. The activity may occur at any point during the mentioned windows, but outside of these instances, your systems will remain fully operational. During those 5 minutes, you may experience elevated error rates (5xx responses) for POST operations.<br /><br />Thank you for your continued trust and understanding.</p>tag:status.chargebee.com,2005:Incident/199651322024-02-24T09:30:56Z2024-02-29T08:07:41ZScheduled Maintenance Notification<p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>09:30</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>04:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>09:11</var> UTC</small><br><strong>Scheduled</strong> - We are committed to providing you with the best possible service and continuously improving our systems to meet your needs. To ensure the highest levels of performance and reliability, we have scheduled system maintenance on the following dates.<br /><br />Maintenance Window:Feb 24th between 04:30 UTC to 09:30 UTC<br /><br />While we have scheduled maintenance on the above-mentioned dates, please be assured that any actual downtime will be extremely brief, not exceeding 5 minutes for each merchant. The activity may occur at any point during the mentioned windows, but outside of these instances, your systems will remain fully operational. During those 5 minutes, you may experience elevated error rates (5xx responses) for POST operations.<br /><br />Thank you for your continued trust and understanding.</p>tag:status.chargebee.com,2005:Incident/200963462024-02-22T05:00:46Z2024-02-29T08:23:05ZNMI Payments Service Disruption<p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>05:00</var> UTC</small><br><strong>Resolved</strong> - Between Feb 20, 2024 at 14:00 and Feb 21, 2024 at 23:00 UTC, certain merchants experienced issues with their payment transactions in the NMI gateway. The error message displayed was "Custom descriptors are not allowed for this processor". The problem occurred after a recent update in our system added a custom descriptor to transactions. We immediately took remedial steps to disable the statement descriptor feature for the affected gateway. We apologize for any inconvenience this may have caused.</p>tag:status.chargebee.com,2005:Incident/200972142024-02-20T10:00:05Z2024-03-04T13:08:26ZGift Subscriptions Checkout Failure using Paypal Payments<p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>10:00</var> UTC</small><br><strong>Resolved</strong> - We discovered an issue where certain customers attempting to make gift subscriptions using PayPal Express Checkout encountered failures due to missing intent ID, resulting in 4xx errors. As an immediate fix, we have implemented support for gift subscriptions within the PayPal Express Checkout payment flow, ensuring all necessary parameters, including intent ID, are correctly passed. We apologize for any inconvenience this may have caused.</p>tag:status.chargebee.com,2005:Incident/200132862024-02-18T14:25:20Z2024-02-18T14:25:20ZTaxJar Service Degradation<p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>14:25</var> UTC</small><br><strong>Resolved</strong> - TaxJar conducted scheduled database maintenance on February 18, 2024, between 13:00 and 14:08 UTC. However, the impact window was observed from 13:05 to 13:25 UTC, during which some merchants experienced minimal service interruption in their subscription workflows, leading to API failures. The maintenance activity has been completed, and the system is now functioning normally. <br /><br />We apologize for any inconvenience caused by this interruption.</p><p><small>Feb <var data-var='date'>18</var>, <var data-var='time'>13:44</var> UTC</small><br><strong>Investigating</strong> - TaxJar integration is currently experiencing service interruptions due to a database upgrade activity in their Infrastructure. <br /><br />Further updates will be provided as soon as possible. For more details, refer to TaxJar's status page: https://status.taxjar.com/incidents/mtvxw4yps4p5</p>tag:status.chargebee.com,2005:Incident/199116602024-02-17T01:00:56Z2024-02-17T01:00:57ZScheduled Infrastructure Maintenance - Chargebee Receivables<p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>01:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>23:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'> 5</var>, <var data-var='time'>11:29</var> UTC</small><br><strong>Scheduled</strong> - Chargebee will perform scheduled Infrastructure maintenance for Receivable services between Feb 16, 2024 23:00 and Feb 17, 2024 01:00 UTC.<br />During this maintenance window, our Receivable database will undergo essential maintenance to enhance its performance and scalability. As a result, there will be a brief downtime of less than thirty minutes. During this time, all requests may fail, and you may encounter 5xx errors.<br /><br />We apologize for any inconvenience this may cause and appreciate your patience and understanding during this maintenance activity.</p>tag:status.chargebee.com,2005:Incident/200002802024-02-16T14:20:50Z2024-02-16T14:20:50ZService Interruption Due to Third-Party Service Provider<p><small>Feb <var data-var='date'>16</var>, <var data-var='time'>14:20</var> UTC</small><br><strong>Resolved</strong> - On Feb 16, 2024 between 13:21 and 13:27 UTC, one of our systems experienced a service interruption. This disruption was caused by an issue on the AWS platform, which led to an unexpected increase in API failures in all the regions.<br /><br />Our technical team promptly identified the cause of the problem as an external issue on the AWS platform and took immediate steps to address it. We apologize for any inconvenience this may have caused.</p>tag:status.chargebee.com,2005:Incident/199728202024-02-13T07:27:30Z2024-02-21T09:20:09ZSSL Certificate Errors for API requests<p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>07:27</var> UTC</small><br><strong>Resolved</strong> - We have noticed these errors between 06:17 UTC and 07:05 UTC. Following thorough monitoring, we can confirm that all systems have stabilized and are operating normally. This incident is now resolved, and we do not anticipate any further impact on our business. We apologize for any inconvenience or disruption caused.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>07:20</var> UTC</small><br><strong>Monitoring</strong> - We traced the failures back to a recent infrastructure change. <br /><br />During an SSL certificate update, compatibility issues emerged with the provided intermediate certificate, resulting in SSL negotiation errors for a portion of clients. It is important to note that browsers/UI requests were not affected, as they support those Certificate Authorities (CAs). <br /><br />We have reverted the changes and are working closely with our certificate provider to procure a universally compatible intermediate and root certificate. We apologize for any inconvenience caused.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>07:19</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>06:45</var> UTC</small><br><strong>Identified</strong> - Chargebee is investigating an issue that could potentially affect some merchants who may notice SSL Certificate Errors for API requests. We will provide further details as more information becomes available.</p>tag:status.chargebee.com,2005:Incident/197739052024-01-19T19:27:36Z2024-01-20T07:49:01ZFailures Noticed In Integration Modules<p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>19:27</var> UTC</small><br><strong>Resolved</strong> - We experienced issues with our internal service due to which some customers faced sync issues with some integration modules such as Hubspot and Salesforce during the below timeframe.<br /><br />18-Jan-2024 between 11:49 and 15:45 UTC<br />19-Jan-2024 between 11:56 and 12:06 UTC<br />19-Jan-2024 between 18:25 and 19:05 UTC<br /><br />Our engineers have identified and fixed the issue. The services are back to normal. Our team is closely monitoring this case. Please reach out to our support team in case you are still facing issues.<br /><br />We apologize for any inconvenience and disruption to service this caused to our customers.</p>tag:status.chargebee.com,2005:Incident/197548452024-01-19T08:00:39Z2024-01-19T08:00:39ZScheduled Maintenance in PayPal Service<p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>08:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>04:01</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>17:16</var> UTC</small><br><strong>Scheduled</strong> - Our third-party provider PayPal has scheduled maintenance on January 19, 2024 between 4:00 AM to 07:30 AM UTC. During the impact window, there will be a 3-minute period of 100% impact resulting in the following PayPal service interruption:<br /><br />Higher than-normal transaction declines<br />PayPal users may experience errors accessing the PayPal website<br />PayPal REST APIs may result in HTTP 500 errors<br />Merchant's Store may not display in the PayPal Consumer Application<br />Impact to Subscriptions<br />Impact to Recurring Payments Profile creation<br /><br />We apologize for any inconvenience this may cause and appreciate your patience and understanding during this maintenance activity.</p>