Thank you for your help! I could finally borrow a neat server machine with 24GB Ram, with fast HDD and CPU (System x3650 M2)
The script is running on it now for 8 hours. 3 MB/s is processed and it is slowing down. With this preformance it will need 60 more hours to finish it. It is far more better than 60 days!
But I still want to otimize on it because it is only the first phase of the two, and maybe I won't have enough time to finish if I need to restart it for some reason.
Do you have any adjustment suggestions? Here are my settings:
107,108c107
< shared_buffers = 3GB
---
> shared_buffers = 32MB
115,116c114,115
< work_mem = 256MB
< maintenance_work_mem = 256MB
---
> #work_mem = 1MB
> #maintenance_work_mem = 16MB
121c120
< max_fsm_pages = 1592000
---
> max_fsm_pages = 204800
153c152
< fsync = off
---
> #fsync = on
163c162
< wal_buffers = 24MB
---
> #wal_buffers = 64kB
172c171
< checkpoint_segments = 20
---
> #checkpoint_segments = 3
174c173
< checkpoint_completion_target = 0.9
---
> #checkpoint_completion_target = 0.5
205c204
< random_page_cost = 1.5
---
> #random_page_cost = 4.0
209c208
< effective_cache_size = 8GB
---
> #effective_cache_size = 128MB
383c381
< autovacuum = off
---
> #autovacuum = on
Thanks in advance!
Lesezeichen