Error while inserting from external table

[plum2906]

During an insert from an external table we got the following error. Is there some configuration change we can make to fix this? Is the problem in the driver, gpfdist or database? As far as I know we are not compressing the table being loaded.

org.postgresql.util.PSQLException - ERROR: Compression failed: insufficient memory (errno=-4) uncompressed len 3712, compressed 3723 (cdbsrlz.c:144)

The SQL being run is like: "insert into data.s%d (select * from data.ex_s%d)"

[carlo.ascani@2ndquadrant.it]

Hello,
I remember an old bug similar to that.
It made a DDL statement involving an external table to possibly fail due to insufficent memory.

That bug has been resolved in Greenplum 4.0.1.
What version are you using?

Regards,

[plum2906]

Thanks for the reply, We are running 4.0.3.

[carlo.ascani@2ndquadrant.it]

Ok,
I will report that to EMC guys.

Thank you

[ads]

Another idea: do you have escaped data in the file, and maybe one of the escapes is wrong?

[plum2906]

Thanks for the suggestions. We are getting more general memory issues (unable to allocate during queries and loading) after approx 6 days of loading. We have raised a service request with EMC.

Will let you know the outcome.

Cheers.

[plum2906]

We are upgrading to 4.1.2 after advice from EMC. In the meantime we improved our loading code to do less queries and less frequent commits and this has slowed the problem right down.

[gabriele@2ndQuadrant.com]

That's great to know!

Thank you for letting us (and the readers of the forum) know.

Cheers,
Gabriele