That would make sense, if ray tracing was actually on. What I'm finding is that AE CC with Mavericks on a early 2013 retina MPB, 2.8ghz, 650m, 750SSD, that AE continues to give memory warnings such as this, while ray tracing preference remains off.
In addition to the error on closing, It also gives this error on startup in the little brown boxes, then it crashes, then reopening the file, AE will launch again normally. Again, no ray tracing chosen. Understood that the MBP may not have the video card horsepower for 3d ray tracing, but, without ray tracing even enabled, these errors are baffling. I'm just guessing that mavericks memory compression and AE might need to chat a little better. it does become quite a nusciance.
Also, AE CC isn't recognizing the CUDA option for 650m as Premiere Does. Latest driver 5.5.28, near new rMBP maxed, so again, baffling as to why. Hope a patch comes soon.