How long can I expect this export to take? I have never used the export before, but it has been frozen like this for 15 minutes now.
It’s just price, and 4 textoption fields, and 1 decimal field.
Litium version: 7.4.3
An export of 8000 products with ~60 fields (mostly text) takes about 10 secs for me to export. Is it in PROD? have you tried on different servers to see if it makes difference?
Are there any errors in the console or bad requests responses in the Network tab?
No, not seeing any errors anywhere, it’s still frozen.
It’s on a test environment. Don’t have a prod yet. It’s the same locally
Had the problem before with the export freezing, you could try unselecting some of the fields and see if it works, could be some error.
Just tried 3k products, with only articleNumber and Variant of. Still froze
Nothing in the event log either?
Which pre-release are you using for 7.4.3?
Can’t find anyting in the logs.
7.4.3-patch-2007111155
The 7.4.3-patch-2007111155 pre-release contains a bug that make slow performance and you are probably experience that, we are working for an updated version.
Is there an estimation for when a fix will be released?
I can only guess and that will be during next week that we can provide and updated version, if this is a pre-release (as the one that you using now) or the final service release is to early to say.
1 Like
Today a new pre-release was published, please try that out instead of your current version.
It made the export work. But going over 4k products takes time.
And trying to export 60k products causes this:
2020-09-14 15:47:08.2741 [App:02] [cc23238d-bd0d-4b4f-a4f9-25bf070010ce] [TRACE] [] Litium.Web.Administration.Products.Export.ExcelExportEngine.Processor - Export d3fdefcb-f1d3-4bf9-b408-84bbd16f9ae7, products loaded.
2020-09-14 15:47:08.5051 [App:02] [cc23238d-bd0d-4b4f-a4f9-25bf070010ce] [TRACE] [] Litium.Web.Administration.Products.Export.ExportToExcel - Exporting 69788 products.
2020-09-14 15:47:08.5051 [App:02] [cc23238d-bd0d-4b4f-a4f9-25bf070010ce] [TRACE] [] Litium.Web.Administration.Products.Export.ExportToExcel - Export products
2020-09-14 15:47:39.2174 [App:02] [] [ERROR] [] Litium.Application.ServiceBus.LocalServiceBusFactoryImpl - Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. Microsoft.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. —> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out
at Microsoft.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction) in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlConnection.cs:line 2205 at Microsoft.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose) in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\TdsParser.cs:line 1668 at Microsoft.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\TdsParser.cs:line 0 at Microsoft.Data.SqlClient.SqlDataReader.TryConsumeMetaData() in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlDataReader.cs:line 1333 at Microsoft.Data.SqlClient.SqlDataReader.get_MetaData() in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlDataReader.cs:line 283 at Microsoft.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString, Boolean isInternal, Boolean forDescribeParameterEncryption, Boolean shouldCacheForAlwaysEncrypted) in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlCommand.cs:line 5638 at Microsoft.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, Boolean inRetry, SqlDataReader ds, Boolean describeParameterEncryptionRequest) in H:\tsaagent1\_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlCommand.cs:line 5404 at Microsoft.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource1 completion, Int32 timeout, Task& task, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry) in H:\tsaagent1_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlCommand.cs:line 4988
at Microsoft.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method) in H:\tsaagent1_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlCommand.cs:line 4842
at Microsoft.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method) in H:\tsaagent1_work\21\s\src\Microsoft.Data.SqlClient\netfx\src\Microsoft\Data\SqlClient\SqlCommand.cs:line 2442
at Microsoft.EntityFrameworkCore.Storage.RelationalCommand.ExecuteReader(RelationalCommandParameterObject parameterObject)
at Microsoft.EntityFrameworkCore.Query.Internal.QueryingEnumerable1.Enumerator.InitializeReader(DbContext _, Boolean result) at Microsoft.EntityFrameworkCore.Storage.ExecutionStrategy.ExecuteImplementation[TState,TResult](Func3 operation, Func3 verifySucceeded, TState state) at Microsoft.EntityFrameworkCore.Query.Internal.QueryingEnumerable1.Enumerator.MoveNext()
at System.Collections.Generic.List1..ctor(IEnumerable1 collection)
at System.Linq.Enumerable.ToList[TSource](IEnumerable1 source) at Litium.Application.Data.Queryable.DbQueryBuilder2.ExecuteInDbContext[TItem](Func1 action) at Litium.Web.Administration.Products.Export.ExportToExcel.GetExportProducts(List1 products, Action1 notifyProduct) at Litium.Web.Administration.Products.Export.ExportToExcel.GetExportProductsTable(List1 products, Action1 notifyProcessed) at Litium.Web.Administration.Products.Export.ExportToExcel.GetWorkbook(PredefinedExportSettings exportSettings, List1 products, Action`1 notifyProcessed)
at Litium.Web.Administration.Products.Export.ExcelExportEngine.Processor.OnMessage(PredefinedExportSettings exportSettings)
at Litium.Application.Common.FifoExecution.WorkItem.<>c.<.cctor>b__7_0(Object s)
at Litium.Application.Common.FifoExecution.WorkItem.Execute()
at Litium.Application.Common.FifoExecution.ProcessQueuedItems(Object ignored)
ClientConnectionId:3bd6ebc4-5be9-48be-913d-db33ce9e3682
Error Number:-2,State:0,Class:11
This is an timeout from the SQL server, how is the memory, cpu and disc activity time when this happen?
It was around this the entire time, the disk went up to 21% and then down again. Im running this locally with a local db right now. The timeout happends after around 1min/1.5min
Is it possible to increese the timeout?
When I running large databases and having to less memory on the computer the SQL server is blocking itself during the time it is waiting for more memory to be free. This can be visible in the activity monitor inside SSMS and will be notified as below image.
This image was captured during export of 140 000 products and I was getting the same error message.
Please, report this as a bug on the docs site and we can investigate the issue.
I could not replicate that exactly, but i guess we get the same issue.
I reported this as a bug, please try to prioritize it, it’s blocking testing for a go live deadline
Today we published a new pre-release, we have tried to export 100 000 products without problem.
1 Like
Awesome! Will try it today 
Did that pre-release solve the export problem for you?