How to free memory after Export is created.

[JurjenRoels]

I have some 30.000 records I want to export.

I run into memory exhaustion issues. So I thought op splitting the exports in separate files and then zip them.

However I still get into memory issues, when looping through the records, because after the export, the memory is still kept.

How can I clear memory? The following code does not work:

$exporterClassName is full className for the Exporter implementing FromCollection

## $i=1;
## $offset=0;
## $limit=2500;
## $counter= 31000;
for($offset=0;$offset<$counter;$offset=$offset+$limit) 
{
                echo memory_get_usage() .PHP_EOL;  #1e pass =300m 2e pass = 700m
                $temp=new $exporterClassName($offset, $limit);
                $temp->store($path.$objectName.'_'.$timestamp.'_part'.$i.'.'.$type, 'exports', $typeExt);
                unset($temp);
                echo memory_get_usage() .PHP_EOL;  # 1e pass = 700m crashes second time
                $i++;
}

Any suggestions on clearing the memory after the creation of the file?

[JurjenRoels]

A tinker of the same after one, trying to clear the memory:

$temp=new KoppelingExport(0,2500);
= KoppelingExport {#6990}

memory_get_usage()
= 46741344

$temp->store('test.xlsx','exports', \Maatwebsite\Excel\Excel::XLSX);
= true

memory_get_usage();
= 54742544

unset($temp)
memory_get_usage();
= 54742448

$temp=null;
= null

memory_get_usage();
= 54742448

unset($temp)
memory_get_usage();
= 54742448

[patrickbrouwers]

I'm not sure what is kept in memory in your case. We are clearing up the phpspreadsheet here https://github.com/SpartnerNL/Laravel-Excel/blob/3.1/src/Writer.php#L178

[patrickbrouwers]

Can you try getting the phpspreadsheet cache PhpOffice\PhpSpreadsheet\Settings::getCache() (I think it is) and see if you can clear that one and see if it has any memory usage drop

[JurjenRoels]

Hi Patrick,

I get this when tinkering:

> $a=PhpOffice\PhpSpreadSheet\Settings::getCache()
= Maatwebsite\Excel\Cache\MemoryCacheDeprecated {#726}

> dd($a);
Maatwebsite\Excel\Cache\MemoryCacheDeprecated^ {#726 // vendor/psy/psysh/src/ExecutionLoopClosure.php(53) : eval()'d code:1
  #memoryLimit: 60000
  #cache: []
}

But you pointed something out (caching). I will try set a config now, using batch and see if I can connect it to redis.

[patrickbrouwers]

Seems the cache did get flushed at the end, so it's probably not that then

[JurjenRoels]

I published a config and set it to illuminate and redis. I now get the repository as an answer:

> $a=PhpOffice\PhpSpreadSheet\Settings::getCache()
= Illuminate\Cache\Repository {#708}

[JurjenRoels]

Hallo Patrick,

By setting the caching to "batch" and raising the memory limit of php tot 256Mb, the crashes have disappeared. Still it seems memory is leaked somewhere, but the ratio execution time versus memory needed is acceptable.

128Mb seems to little for any table passing more then 5000 records to Excel Export at the moment?

Thanks for the pointer.