Problem
The malloc functions can cause internal program corruption if
passed a very large size value (for example, greater than 2Gb),
or if passed a negative value. This internal corruption leads
to a core dump when subsequent routines try to allocate or use
memory. Solution
This has been reported to SCO Engineering and has been fixed for the next SCO OpenServer release.
To avoid the problem, ensure that the value of the "size" argument passed to malloc is between 0 and 2Gb.
See also
Manual page for malloc(S)