RocketMan Backoffice - Hangfire Dashboard

ICheckNotification.RunDoWorkAsync

The job is finished. It will be removed automatically 01/01/0001 00:00:00. 
// Id: #135627
using RocketMan.Backoffice.BackgroundJob.ServicesJobs;

var checkNotification = Activate<ICheckNotification>();
await checkNotification.RunDoWorkAsync(null);

Parameters

CurrentCulture 
""
CurrentUICulture 
""
RecurringJobId 
"task-update-mysql"
RetryCount 
10
Time 
1761778215

State

10/30/2025 03:31:23 (+1h 53m) Failed

Failed to change state to the 'Enqueued' one due to an exception after 5 retry attempts

MySqlConnector.MySqlException (rocketmanhangfireserver:1)

XA_RBDEADLOCK: Transaction branch was rolled back: deadlock was detected

MySqlConnector.MySqlException: XA_RBDEADLOCK: Transaction branch was rolled back: deadlock was detected
   at MySqlConnector.Core.ServerSession.ReceiveReplyAsync(IOBehavior ioBehavior, CancellationToken cancellationToken)
   at MySqlConnector.Core.ResultSet.ReadResultSetHeaderAsync(IOBehavior ioBehavior)
   at MySqlConnector.MySqlDataReader.ActivateResultSet(CancellationToken cancellationToken)
   at MySqlConnector.MySqlDataReader.InitAsync(CommandListPosition commandListPosition, ICommandPayloadCreator payloadCreator, IDictionary`2 cachedProcedures, IMySqlCommand command, CommandBehavior behavior, Activity activity, IOBehavior ioBehavior, CancellationToken cancellationToken)
   at MySqlConnector.Core.CommandExecutor.ExecuteReaderAsync(CommandListPosition commandListPosition, ICommandPayloadCreator payloadCreator, CommandBehavior behavior, Activity activity, IOBehavior ioBehavior, CancellationToken cancellationToken)
   at MySqlConnector.MySqlCommand.ExecuteNonQueryAsync(IOBehavior ioBehavior, CancellationToken cancellationToken)
   at Dapper.SqlMapper.ExecuteCommand(IDbConnection cnn, CommandDefinition& command, Action`2 paramReader)
   at Dapper.SqlMapper.ExecuteImpl(IDbConnection cnn, CommandDefinition& command)
   at Hangfire.MySql.MySqlDistributedLock.Acquire()
   at Hangfire.States.BackgroundJobStateChanger.ChangeState(StateChangeContext context)
   at Hangfire.Server.DelayedJobScheduler.EnqueueBackgroundJob(BackgroundProcessContext context, IStorageConnection connection, String jobId)

+2ms Scheduled

Retry attempt 10 of 10: Authentication Error - No credentials provided

Enqueue at:
10/30/2025 03:31:29

+310ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+1.060s Processing

Server:
rocketmanhangfireserver:1
Worker:
def5edbb

+1h 12m Enqueued

Triggered by DelayedJobScheduler

+1ms Scheduled

Retry attempt 9 of 10: Authentication Error - No credentials provided

Enqueue at:
10/30/2025 01:38:08

+1.028s Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+11.550s Processing

Server:
rocketmanhangfireserver:1
Worker:
5b83fed9

+44m 1.918s Enqueued

Triggered by DelayedJobScheduler

+2ms Scheduled

Retry attempt 8 of 10: Authentication Error - No credentials provided

Enqueue at:
10/30/2025 00:25:22

+224ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+39.358s Processing

Server:
rocketmanhangfireserver:1
Worker:
9904ae48

+23m 28.099s Enqueued

Triggered by DelayedJobScheduler

+4ms Scheduled

Retry attempt 7 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 23:40:24

+195ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+7.217s Processing

Server:
rocketmanhangfireserver:1
Worker:
9904ae48

+11m 56.058s Enqueued

Triggered by DelayedJobScheduler

+2ms Scheduled

Retry attempt 6 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 23:16:42

+272ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+51.239s Processing

Server:
rocketmanhangfireserver:1
Worker:
9904ae48

+6m 10.609s Enqueued

Triggered by DelayedJobScheduler

+1ms Scheduled

Retry attempt 5 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 23:03:45

+161ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+5.656s Processing

Server:
rocketmanhangfireserver:1
Worker:
4197db6b

+3m 54.881s Enqueued

Triggered by DelayedJobScheduler

+1ms Scheduled

Retry attempt 4 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 22:57:24

+246ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+20.659s Processing

Server:
rocketmanhangfireserver:1
Worker:
4197db6b

+1m 39.366s Enqueued

Triggered by DelayedJobScheduler

+1ms Scheduled

Retry attempt 3 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 22:53:54

+568ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+35.507s Processing

Server:
rocketmanhangfireserver:1
Worker:
02067e45

+24.534s Enqueued

Triggered by DelayedJobScheduler

+1ms Scheduled

Retry attempt 2 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 22:52:37

+958ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+50.131s Processing

Server:
rocketmanhangfireserver:1
Worker:
02067e45

+9.725s Enqueued

Triggered by DelayedJobScheduler

+1ms Scheduled

Retry attempt 1 of 10: Authentication Error - No credentials provided

Enqueue at:
10/29/2025 22:50:38

+112ms Failed

An exception occurred during performance of the job.

Twilio.Exceptions.ApiException (rocketmanhangfireserver:1)

Authentication Error - No credentials provided

Twilio.Exceptions.ApiException: Authentication Error - No credentials provided
   at Twilio.Clients.TwilioRestClient.ProcessResponse(Response response)
   at Twilio.Clients.TwilioRestClient.RequestAsync(Request request)
   at Twilio.Rest.Api.V2010.Account.MessageResource.CreateAsync(CreateMessageOptions options, ITwilioRestClient client)
   at RocketMan.Backoffice.Services.WhatsAppMessageService.TwilioWhatsAppMessage.SendMessageAsync(ServiceOrderCreationMessage message)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.SendSingleNotification(ServiceOrderCreationMessage message, Int32 notificationId, CancellationToken cancellationToken)
   at RocketMan.Backoffice.BackgroundJob.ServicesJobs.CheckNotification.RunDoWorkAsync(CancellationToken cancellationToken)
   at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr*)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)

+6.466s Processing

Server:
rocketmanhangfireserver:1
Worker:
9904ae48

+20ms Enqueued

Triggered by recurring job scheduler

10/29/2025 22:50:15 Created