tag:status.symphonytalent.com,2005:/historySymphony Talent Status - Incident History2024-03-28T20:06:32-04:00Symphony Talenttag:status.symphonytalent.com,2005:Incident/203892832024-03-28T16:59:41-04:002024-03-28T16:59:41-04:00Investigating Bulk Import Issue<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>16:59</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>16:20</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and the bulk import is now functioning as expected. Our team is currently monitoring to ensure everything remains operational.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>12:02</var> EDT</small><br><strong>Update</strong> - We are currently investigating an issue related to the bulk import function of the SFX CRM that is resulting in delayed import of contacts for some users.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>12:01</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue with the Bulk Import tool of the SFX CRM that is preventing the completion of bulk uploads for some users.</p>tag:status.symphonytalent.com,2005:Incident/203512432024-03-25T14:25:11-04:002024-03-25T14:25:11-04:00Issue with SFX Landing Pages<p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>14:25</var> EDT</small><br><strong>Resolved</strong> - Internal monitoring indicates a return to normal functionality and performance levels during the monitoring period.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>12:01</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are currently monitoring the results.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>10:22</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue that is blocking the creation of landing pages, as well as the displaying of the list of existing landing pages, within SFX. The functionality of loading existing land page URLs is NOT affected.</p>tag:status.symphonytalent.com,2005:Incident/197549532024-01-18T15:24:05-05:002024-01-18T15:24:05-05:00Career Website Issue Being Investigated<p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>15:24</var> EST</small><br><strong>Resolved</strong> - Continued monitoring of performance metrics indicate a return to normal performance levels for the last 45 minutes.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>14:06</var> EST</small><br><strong>Monitoring</strong> - At approximately 1:50 PM US-Eastern an issue was identified and a fix was implemented. We are seeing improvement to response times and are continuining to monitor performance of the SFX Career Website platform.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>12:26</var> EST</small><br><strong>Investigating</strong> - We are currently investigating an issue on our SFX Career Website platform that is resulting in increased response times on some of our career websites.</p>tag:status.symphonytalent.com,2005:Incident/196582362024-01-17T23:31:20-05:002024-01-17T23:31:20-05:00SFX - Career Sites Scheduled Maintenance (Jan 11th at 10:30PM EST)<p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>23:31</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>22:30</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>10:30</var> EST</small><br><strong>Scheduled</strong> - We will be performing software updates to the CWS platform on Jan. 17th at 10:30 PM EST. We do not anticipate any down time, but sites may experience minor issues during this period. There will be no changes to site functionality and clients do not have to take any action at this time.</p>tag:status.symphonytalent.com,2005:Incident/195115212023-12-23T05:02:49-05:002023-12-23T05:02:49-05:00Career Websites - Slow Response Times<p><small>Dec <var data-var='date'>23</var>, <var data-var='time'>05:02</var> EST</small><br><strong>Resolved</strong> - The problem has been resolved.</p><p><small>Dec <var data-var='date'>23</var>, <var data-var='time'>04:57</var> EST</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Dec <var data-var='date'>23</var>, <var data-var='time'>00:34</var> EST</small><br><strong>Identified</strong> - The issue has been identified and we have applied a fix.</p><p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>23:56</var> EST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing job search results and job details pages to load in a slower than normal manner. We will provide an update as soon as possible.</p>tag:status.symphonytalent.com,2005:Incident/193678612023-12-07T13:32:01-05:002023-12-07T13:32:01-05:00Career Websites - Slow Response Times<p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>13:32</var> EST</small><br><strong>Resolved</strong> - Internal performance metrics have held stable in the last hour indicating the issue is resolved.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>12:04</var> EST</small><br><strong>Monitoring</strong> - After the fix was applied we have seen improved response times for career websites. We are continuing to monitor internal performance metrics.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>11:48</var> EST</small><br><strong>Identified</strong> - The issue has been identified and a fix has been applied. We are continuing to monitor internal performance metrics.</p><p><small>Dec <var data-var='date'> 7</var>, <var data-var='time'>10:34</var> EST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is resulting in slow response times on some career websites.</p>tag:status.symphonytalent.com,2005:Incident/192422092023-11-29T09:55:32-05:002023-11-29T09:55:32-05:00Career Websites - Slow Response Times<p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:55</var> EST</small><br><strong>Resolved</strong> - Internal performance metrics have returned to normal levels.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:24</var> EST</small><br><strong>Monitoring</strong> - After the fix was applied we have seen improved response times for career websites. We are continuing to monitor internal performance metrics.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>09:01</var> EST</small><br><strong>Identified</strong> - This issue has been identified and a fix is being applied.</p><p><small>Nov <var data-var='date'>29</var>, <var data-var='time'>08:35</var> EST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is resulting in slow response times on some career websites.</p>tag:status.symphonytalent.com,2005:Incident/190484592023-11-10T09:50:51-05:002023-11-10T09:50:51-05:00Google Talent Cloud Issue Identified<p><small>Nov <var data-var='date'>10</var>, <var data-var='time'>09:50</var> EST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>16:17</var> EST</small><br><strong>Monitoring</strong> - A fix has been implemented and is being monitored. Normal Google Talent Cloud functionality is returning to most sites, with a small number of exceptions that we are addressing individually.</p><p><small>Nov <var data-var='date'> 9</var>, <var data-var='time'>11:21</var> EST</small><br><strong>Identified</strong> - Google has identified an issue related to a previous update and is releasing a fix. More information still to come regarding timing.</p><p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>13:00</var> EST</small><br><strong>Investigating</strong> - We are currently investigating a sync issue with Google Jobs API that is resulting in some jobs not successfully updating to career sites for clients utilizing the Google Talent Cloud</p>tag:status.symphonytalent.com,2005:Incident/189717552023-10-30T19:23:15-04:002023-10-30T19:23:15-04:00CWS and CRM SSO Errors<p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>19:23</var> EDT</small><br><strong>Resolved</strong> - Internal performance metrics indicate a return to normal operations.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>16:26</var> EDT</small><br><strong>Monitoring</strong> - Our downstream provider has restored service and we are monitoring internal performance metrics.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>16:16</var> EDT</small><br><strong>Identified</strong> - Symphony Talent engineers are aware of an issue with a downstream authentication provider that is causing various components to display an error message stating "Internal Edge Error" . We continue to monitor our downstream provider for updates and will post them here accordingly. <br />Only those clients that use SSO (Single Sign On) for CRM or certain internal facing career sites (internal jobs, referrals) are impacted.</p>tag:status.symphonytalent.com,2005:Incident/189484202023-10-27T19:29:41-04:002023-10-27T19:29:41-04:00Jobs API Issue Being Investigated<p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>19:29</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>18:35</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented as normal functionality has returned. We will continue to monitor to ensure consistency.</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>18:25</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>15:35</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue with our jobs API that is resulting in some Career Website job description pages returning error messages.</p>tag:status.symphonytalent.com,2005:Incident/189457692023-10-27T16:38:32-04:002023-10-27T16:38:32-04:00SFX Workflow Issue Being Investigated<p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>16:38</var> EDT</small><br><strong>Resolved</strong> - This incident has now been resolved and workflows are functioning as expected.</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>10:03</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue within the SFX CRM that is affecting the functionality of workflows that are configured with a delayed action.</p>tag:status.symphonytalent.com,2005:Incident/186706752023-10-03T05:17:25-04:002023-10-03T05:17:25-04:00HR Logix Ad Hoc Reporting Issue Being Investigated<p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>05:17</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>05:17</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>05:17</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Oct <var data-var='date'> 2</var>, <var data-var='time'>16:53</var> EDT</small><br><strong>Investigating</strong> - Our team is currently investigating an issue related to ad hoc reporting within HR Logix. This will impact user ability to write reports and run external reports.</p>tag:status.symphonytalent.com,2005:Incident/186323332023-10-03T00:30:09-04:002023-10-03T00:30:10-04:00SFX - Career Sites Scheduled Maintenance (Oct 2nd at 11:30PM EST)<p><small>Oct <var data-var='date'> 3</var>, <var data-var='time'>00:30</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 2</var>, <var data-var='time'>23:31</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>09:56</var> EDT</small><br><strong>Scheduled</strong> - We will be performing software updates to the CWS platform on Monday, October 2nd at 11:30 PM EST. We do not anticipate any down time, but sites may experience minor issues during this period. There will be no changes to site functionality and clients do not have to take any action at this time.</p>tag:status.symphonytalent.com,2005:Incident/184705062023-09-15T03:31:13-04:002023-09-15T03:31:13-04:00SFX CRM Maintenance - Search Infrastructure Upgrade<p><small>Sep <var data-var='date'>15</var>, <var data-var='time'>03:31</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>22:31</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>11</var>, <var data-var='time'>11:33</var> EDT</small><br><strong>Update</strong> - We will be undergoing scheduled maintenance during this time.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>22:30</var> EDT</small><br><strong>Scheduled</strong> - The Symphony Talent team will be performing an upgrade to the searching infrastructure supporting the CRM application on Thursday night, Sept 14th from 10:30 PM EST to 3:30 AM EST. During this time there will be brief interruptions of service to the CRM. This activity is necessary to maintain the ongoing stability and performance of services provided. There are no further actions required at this time.</p>tag:status.symphonytalent.com,2005:Incident/183516892023-09-08T01:30:05-04:002023-09-08T01:30:05-04:00SFX CRM Maintenance - Search Infrastructure Upgrade<p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>01:30</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>20:30</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'> 1</var>, <var data-var='time'>13:50</var> EDT</small><br><strong>Scheduled</strong> - The Symphony Talent team will be performing an upgrade to the searching infrastructure supporting the CRM application on Thursday night, Sept 7th from 10:30 PM EST to 3:30 AM EST. During this time there will be brief interruptions of service to the CRM. This activity is necessary to maintain the ongoing stability and performance of services provided. There are no further actions required at this time.</p>tag:status.symphonytalent.com,2005:Incident/182104642023-08-21T11:28:27-04:002023-08-21T11:28:27-04:00Career Web Site (CWS Platform) Slow Load Times<p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>11:28</var> EDT</small><br><strong>Resolved</strong> - Internal performance metrics have remained stable since the last update and load times for career websites remains within normal bounds.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>10:23</var> EDT</small><br><strong>Monitoring</strong> - Engineers have identified the issue causing higher load times and have applied a fix. We are seeing vastly improved load times for career websites hosted on our Career Websites (CWS) platform. We will continue to monitor performance metrics.</p><p><small>Aug <var data-var='date'>21</var>, <var data-var='time'>09:57</var> EDT</small><br><strong>Investigating</strong> - Symphony Talent engineers are aware of and investigating an issue causing higher than normal load times for career websites hosted on our Career Websites (CWS) platform.</p>tag:status.symphonytalent.com,2005:Incident/181679982023-08-16T21:24:32-04:002023-08-16T21:24:32-04:00Career Website Platform Error Message<p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>21:24</var> EDT</small><br><strong>Resolved</strong> - Internal performance metrics have returned to normal levels and no error messages are being seen on internal or external URLs.</p><p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>20:43</var> EDT</small><br><strong>Monitoring</strong> - A fix has been applied and we are no longer seeing error messages appear on external career websites and admin urls. We are continuing to monitor performance of the CWS platform.</p><p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>20:37</var> EDT</small><br><strong>Identified</strong> - Engineers have identified the issue and are in the process of applying a fix.</p><p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>20:18</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue that has resulted in an error message appearing on some external career website pages and admin urls.</p>tag:status.symphonytalent.com,2005:Incident/180378582023-08-03T04:14:56-04:002023-08-03T04:14:56-04:00CWS Platform High Response Times<p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>04:14</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'> 3</var>, <var data-var='time'>00:15</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating reports of page load issues on the CWS platform.</p>tag:status.symphonytalent.com,2005:Incident/179789352023-07-27T17:08:08-04:002023-07-27T17:08:08-04:00Error Message On Career Websites<p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>17:08</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved. Our performance metrics are indicating a full return to normal levels.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>16:27</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and both external domains and admin urls are all loading without issue. Our teams will be monitoring.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>16:09</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and the team is currently working towards resolution.</p><p><small>Jul <var data-var='date'>27</var>, <var data-var='time'>15:29</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue that has resulted in an error message appearing on some external career website pages and admin urls.</p>tag:status.symphonytalent.com,2005:Incident/177744522023-07-23T09:38:01-04:002023-07-23T09:38:01-04:00SFX Email Template Maintenance<p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>09:38</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>23</var>, <var data-var='time'>08:01</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'> 5</var>, <var data-var='time'>17:07</var> EDT</small><br><strong>Scheduled</strong> - On Sunday, July 23, 2023 a downstream vendor will be performing scheduled maintenance from 8:00AM to 10:00AM EDT (New York City). During this time, clients will be unable to create or edit email campaign templates within the SFX CRM application. Symphony Talent engineers will be monitoring the vendor's notification channels and will perform verification of the vendor's functionality once the maintenance is completed.</p>tag:status.symphonytalent.com,2005:Incident/177803202023-07-11T00:30:12-04:002023-07-11T00:30:12-04:00SFX - Career Sites Scheduled Maintenance (July 10th at 10:30PM EST)<p><small>Jul <var data-var='date'>11</var>, <var data-var='time'>00:30</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>10</var>, <var data-var='time'>22:31</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'> 6</var>, <var data-var='time'>09:49</var> EDT</small><br><strong>Scheduled</strong> - We will be performing software updates to the CWS platform on Monday, July 10th at 10:30 PM EST. We do not anticipate any down time, but sites may experience minor issues during this period. There will be no changes to site functionality and clients do not have to take any action at this time.</p>tag:status.symphonytalent.com,2005:Incident/177003082023-06-30T01:00:22-04:002023-06-30T01:00:22-04:00HRLogix Maintenance - June 29th<p><small>Jun <var data-var='date'>30</var>, <var data-var='time'>01:00</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>22:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>27</var>, <var data-var='time'>11:32</var> EDT</small><br><strong>Scheduled</strong> - On Thursday, June 29th at 10:00 PM EST, we will be performing an infrastructure upgrade to the HRLogix platform. The HRLogix system could be unavailable intermittently for brief periods during this scheduled maintenance window.</p>tag:status.symphonytalent.com,2005:Incident/176917302023-06-26T18:32:49-04:002023-06-26T18:32:49-04:00Google Talent Cloud Issue Being Investigated<p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>18:32</var> EDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>17:59</var> EDT</small><br><strong>Monitoring</strong> - A fix has been implemented and jobs are now syncing properly.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>17:13</var> EDT</small><br><strong>Identified</strong> - The issue has been identified and our engineers are currently working towards a resolution.</p><p><small>Jun <var data-var='date'>26</var>, <var data-var='time'>16:02</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue with the API sync for clients that have Google Talent Cloud in place. This may result in 404 error messages appearing on recently closed job listings.</p>tag:status.symphonytalent.com,2005:Incident/175643252023-06-13T18:03:07-04:002023-06-13T18:03:07-04:00SFX CRM Login Issue Being Investigated<p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>18:03</var> EDT</small><br><strong>Resolved</strong> - This issue is now resolved and all logins are functioning as expected.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>16:55</var> EDT</small><br><strong>Monitoring</strong> - The login issue has been resolved and is currently being monitored.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>16:29</var> EDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>16:19</var> EDT</small><br><strong>Investigating</strong> - We are currently investigating an issue on SFX CRM instances that could result in issues with logging in.</p>tag:status.symphonytalent.com,2005:Incident/175228982023-06-09T10:53:33-04:002023-06-09T10:53:33-04:00CWS Career Sites Slow Load Times<p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>10:53</var> EDT</small><br><strong>Resolved</strong> - Our performance monitoring indicates a return to normal levels for the last 45 minutes.</p><p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>10:08</var> EDT</small><br><strong>Monitoring</strong> - We have identified the issue and implemented a fix. We are monitoring performance levels.</p><p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>09:57</var> EDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>09:57</var> EDT</small><br><strong>Investigating</strong> - Our engineers are aware of and we are currently investigating an issue with our CWS (Career Website) platform that is causing slow load times.</p>