TexGen/DynDOLOD out of graphics memory Linux

[Vraylle]

I'm attaching the realtime log, as that's the only one I can generate.

I'm running TexGen for SSE under Proton 9.0.4 on Linux. The PC has 64GB RAM and 8GB swap.

After scanning the load order, TexGen displays "Gathering base records for billboards". Then memory usage (RAM and SWAP) go to 100% and the entire system freezes. After about 15 minutes, the entire Wine prefix dies/crashes. Memory is recovered but the swap remains about half full. I can see from the realtime log that it seems to be doing work, but since it uses everything it looks like the OS is killing the process when it gets the chance (again, about 15 minutes later).

I've been looking for a way to restrict the memory available to that process to just let it run and see what happens, but haven't had any luck yet.

I will say this is the first time I've run it on this particular PC, but I've run it many, many times prior.

[mrmalin]

with GLDebug=1

TexGen_SSE_log.txt
TexGen_SSE_Debug_log.txt (mediafire, 71mb)
bugreport.txt

[sheson]

On 9/10/2025 at 8:12 PM, mrmalin said:

with GLDebug=1

TexGen_SSE_log.txt
TexGen_SSE_Debug_log.txt (mediafire, 71mb)
bugreport.txt

Test what happens with the latest test version https://dyndolod.info/Downloads/Test-Versions
Set GLDebug=0 so it the first test doesn't take that long. If it fails run again with GLDebug=1 for more detailed logs. Upload logs either way and bugreport as well if it failed.

[mrmalin]

GLDebug=0, no problems, texgen ran through and finished succesfully.
TexGen_SSE_Debug_log.txt
TexGen_SSE_log.txt
trying dyndolod now

[sheson]

On 9/11/2025 at 5:24 PM, mrmalin said:

GLDebug=0, no problems, texgen ran through and finished succesfully.
TexGen_SSE_Debug_log.txt
TexGen_SSE_log.txt
trying dyndolod now

Here is a DynDOLOD test version with the same changes https://dyndolod.info/Downloads/Test-Versions in case it has similar issues when generating textures.

[mrmalin]

the 196 dyndolod exe gave an error after 1h of generating files, 271mb of logs and no bugreports.txt
logs
trying the test version now

Edited September 11 by mrmalin

[sheson]

36 minutes ago, mrmalin said:

the 196 dyndolod exe gave an error after 1h of generating files, 271mb of logs and no bugreports.txt
logs
trying the test version now

The reported error happened with LODGen generating object LOD meshes for DLC2SolstheimWorld.

<Error: LODGenx64Win.exe failed to generate object LOD for DLC2SolstheimWorld. LODGenx64Win.exe returned C0000409. Check Z:\run\media\nvme1\MO2\Tools\DynDOLOD\Logs\LODGen_SSE_DLC2SolstheimWorld_log.txt

The log itself does not reveal anything. It is possible the command line window might if you get a glimpse if it.

https://dyndolod.info/Messages/LODGen-Failed-To-Generate-Object-LOD and https://dyndolod.info/Help/LODGen. Do this:
To restart LODGen generation for a worldspace in case there is no LODGen_[GAME MODE]_[WORLDSPACE]_log.txt or it does not contain a useful error message, start DynDOLOD in expert mode, select the desired worldspace and click Execute LODGen. Bring the LODGen command prompt window to the front to see if it prints more details to the console. If that does not give more detail, check the Windows Event Viewer for additional messages from the .Net Framework or the .NET Desktop Runtime.

If the .Net 6 LODGenx64Win.exe keeps having problems, you could try making repairing/reinstalling the .NET 6 installation, or hide the LODGenx64Win.exe by renaming it, so DynDOLOD falls back to LODGenx64.exe, the .Net Framework 4.8 version.

[mrmalin]

i got .net 9 installed in the prefix, just checked the backwards comp and it goes down to 4.5. installing 4-4.8 is borked since proton 5. fallback to LODGenx64.exe returns found .net 4.8 but errors before the settings menu. one thing i noticed is it outputs 12gb of files and even shows the save and zip options menu at the end but it doesnt generate occlusion at all.
LODGenx64_SSE_Test_log.txt

DynDOLOD_SSE_log.txt

DynDOLOD_SSE_Debug_log.txt

no bugreports.txt

Edited September 12 by mrmalin

[sheson]

On 9/12/2025 at 9:44 PM, mrmalin said:

i got .net 9 installed in the prefix, just checked the backwards comp and it goes down to 4.5. installing 4-4.8 is borked since proton 5. fallback to LODGenx64.exe returns found .net 4.8 but errors before the settings menu. one thing i noticed is it outputs 12gb of files and even shows the save and zip options menu at the end but it doesnt generate occlusion at all.
LODGenx64_SSE_Test_log.txt

DynDOLOD_SSE_log.txt

DynDOLOD_SSE_Debug_log.txt

no bugreports.txt

The .Net Frameworks are also covered by Mono in case .Net Framework 4.8 can not be installed properly anymore. I believe for LODGenx64.exe to work with Mono under Wine you need to set the OS to Windows 8.1 or lower in the WineCfg for the DynDOLODx64.exe.

If you do not have .NET 6 Desktop installed LODGenx64Win.exe should not be able to run and would typically output something like this:

You must install or update .NET to run this application.
App: LODGenx64Win.exe
Architecture: x64
Framework: 'Microsoft.NETCore.App', version '6.0.0' (x64)
.NET location: C:\Program Files\dotnet\
The following frameworks were found:
  7.0.20 at [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  8.0.11 at [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  9.0.0 at [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Learn more:
https://aka.ms/dotnet/app-launch-failed
To install missing framework, download:
https://aka.ms/dotnet-core-applaunch?framework=Microsoft.NETCore.App&framework_version=6.0.0&arch=x64&rid=win-x64&os=win10

The LODGen logs uploaded earlier show that .NET 6.0.36 is installed.

See https://dyndolod.info/FAQ#Long-running-time-or-output-several-GB-in-file-size

The DynDOLOD log provided earlier, shows this line:
<Error: Occlusion generation aborted due to LODGen error>

You can generate Occlusion.esp only once object LOD was generated successfully for the DLC2SolstheimWorld worldspace that failed, for example by Executing LODGen in expert mode as I suggested earlier. See https://dyndolod.info/Help/Occlusion-Data#Generation
To only generate or update Occlusion.esp with DynDOLOD, disable all other options and only check Occlusion Data and Plugin.