malloc / free / new / delete에서 OS가 언제 그리고 왜 메모리를 0xCD, 0xDD 등으로 초기화합니까?
OS가 때때로 0xCD 및 0xDD와 같은 특정 패턴으로 메모리를 초기화한다는 것을 알고 있습니다. 내가 알고 싶은 것은 언제 그리고 왜 이런 일이 발생 하는지 입니다.
언제
사용 된 컴파일러에만 해당됩니까?
malloc / new 및 free / delete가 이와 관련하여 동일한 방식으로 작동합니까?
특정 플랫폼입니까?
Linux 또는 VxWorks와 같은 다른 운영 체제에서도 발생합니까?
왜
내 이해는 Win32 디버그 구성에서만 발생하며 메모리 오버런을 감지하고 컴파일러가 예외를 포착하는 데 도움이됩니다.
이 초기화가 어떻게 유용한 지에 대한 실제적인 예를들 수 있습니까?
메모리를 할당 할 때 알려진 패턴으로 메모리를 초기화하는 것이 좋으며 특정 패턴은 Win32에서 인터럽트를 트리거하여 디버거에 예외가 표시되는 것을 읽었습니다 (Code Complete 2).
이것은 얼마나 휴대 할 수 있습니까?
디버그 모드 용으로 컴파일 될 때 다양한 비트의 소유되지 않은 / 초기화되지 않은 메모리에 Microsoft 컴파일러가 사용하는 내용에 대한 간략한 요약 (지원은 컴파일러 버전에 따라 다름)
Value Name Description
------ -------- -------------------------
0xCD Clean Memory Allocated memory via malloc or new but never
written by the application.
0xDD Dead Memory Memory that has been released with delete or free.
Used to detect writing through dangling pointers.
0xED or Aligned Fence 'No man's land' for aligned allocations. Using a
0xBD different value here than 0xFD allows the runtime
to detect not only writing outside the allocation,
but to also detect mixing alignment-specific
allocation/deallocation routines with the regular
ones.
0xFD Fence Memory Also known as "no mans land." This is used to wrap
the allocated memory (surrounding it with a fence)
and is used to detect indexing arrays out of
bounds or other accesses (especially writes) past
the end (or start) of an allocated block.
0xFD or Buffer slack Used to fill slack space in some memory buffers
0xFE (unused parts of `std::string` or the user buffer
passed to `fread()`). 0xFD is used in VS 2005 (maybe
some prior versions, too), 0xFE is used in VS 2008
and later.
0xCC When the code is compiled with the /GZ option,
uninitialized variables are automatically assigned
to this value (at byte level).
// the following magic values are done by the OS, not the C runtime:
0xAB (Allocated Block?) Memory allocated by LocalAlloc().
0xBAADF00D Bad Food Memory allocated by LocalAlloc() with LMEM_FIXED,but
not yet written to.
0xFEEEFEEE OS fill heap memory, which was marked for usage,
but wasn't allocated by HeapAlloc() or LocalAlloc().
Or that memory just has been freed by HeapFree().
면책 조항 : 테이블은 내가 누워있는 메모 중 일부입니다 .100 % 정확하지 않거나 일관성이 없을 수 있습니다.
이러한 값 중 다수는 vc / crt / src / dbgheap.c에 정의되어 있습니다.
/*
* The following values are non-zero, constant, odd, large, and atypical
* Non-zero values help find bugs assuming zero filled data.
* Constant values are good so that memory filling is deterministic
* (to help make bugs reproducable). Of course it is bad if
* the constant filling of weird values masks a bug.
* Mathematically odd numbers are good for finding bugs assuming a cleared
* lower bit.
* Large numbers (byte values at least) are less typical, and are good
* at finding bad addresses.
* Atypical values (i.e. not too often) are good since they typically
* cause early detection in code.
* For the case of no-man's land and free blocks, if you store to any
* of these locations, the memory integrity checker will detect it.
*
* _bAlignLandFill has been changed from 0xBD to 0xED, to ensure that
* 4 bytes of that (0xEDEDEDED) would give an inaccessible address under 3gb.
*/
static unsigned char _bNoMansLandFill = 0xFD; /* fill no-man's land with this */
static unsigned char _bAlignLandFill = 0xED; /* fill no-man's land for aligned routines */
static unsigned char _bDeadLandFill = 0xDD; /* fill free objects with this */
static unsigned char _bCleanLandFill = 0xCD; /* fill new objects with this */
There are also a few times where the debug runtime will fill buffers (or parts of buffers) with a known value, for example the 'slack' space in std::string
's allocation or the buffer passed to fread()
. Those cases use a value given the name _SECURECRT_FILL_BUFFER_PATTERN
(defined in crtdefs.h
). I'm not sure exactly when it was introduced, but it was in the debug runtime by at least VS 2005 (VC++8).
Initially the value used to fill these buffers was 0xFD
- the same value used for no man's land. However, in VS 2008 (VC++9) the value was changed to 0xFE
. I assume that's because there could be situations where the fill operation would run past the end of the buffer, for example if the caller passed in a buffer size that was too large to fread()
. In that case, the value 0xFD
might not trigger detecting this overrun since if the buffer size was too large by just one, the fill value would be the same as the no man's land value used to initialize that canary. No change in no man's land means the overrun wouldn't be noticed.
So the fill value was changed in VS 2008 so that such a case would change the no man's land canary, resulting in detection of the problem by the runtime.
As others have noted, one of the key properties of these values is that is a pointer variable with one of these values is dereferenced, it will result in an access violation, since on a standard 32-bit Windows configuration, user mode addresses will not go higher than 0x7fffffff.
One nice property about the fill value 0xCCCCCCCC is that in x86 assembly, the opcode 0xCC is the int3 opcode, which is the software breakpoint interrupt. So, if you ever try to execute code in uninitialized memory that's been filled with that fill value, you'll immediately hit a breakpoint, and the operating system will let you attach a debugger (or kill the process).
It's compiler and OS specific, Visual studio sets different kinds of memory to different values so that in the debugger you can easily see if you have overun into into malloced memory, a fixed array or an uninitialised object. Somebody will post the details while I am googling them...
http://msdn.microsoft.com/en-us/library/974tc9t1.aspx
It's not the OS - it's the compiler. You can modify the behaviour too - see down the bottom of this post.
Microsoft Visual Studio generates (in Debug mode) a binary that pre-fills stack memory with 0xCC. It also inserts a space between every stack frame in order to detect buffer overflows. A very simple example of where this is useful is here (in practice Visual Studio would spot this problem and issue a warning):
...
bool error; // uninitialised value
if(something)
{
error = true;
}
return error;
If Visual Studio didn't preinitialise variables to a known value, then this bug could potentially be hard to find. With preinitialised variables (or rather, preinitialised stack memory), the problem is reproducible on every run.
However, there is a slight problem. The value Visual Studio uses is TRUE - anything except 0 would be. It is actually quite likely that when you run your code in Release mode that unitialised variables may be allocated to a piece of stack memory that happens to contain 0, which means you can have an unitialised variable bug which only manifests itself in Release mode.
That annoyed me, so I wrote a script to modify the pre-fill value by directly editing the binary, allowing me to find uninitalized variable problems that only show up when the stack contains a zero. This script only modifies the stack pre-fill; I never experimented with the heap pre-fill, though it should be possible. Might involve editing the run-time DLL, might not.
Is this specific to the compiler used?
Actually, it's almost always a feature of the runtime library (like the C runtime library). The runtime is usually strongly correlated with the compiler, but there are some combinations you can swap.
I believe on Windows, the debug heap (HeapAlloc, etc.) also uses special fill patterns which are different than the ones that come from the malloc and free implementations in the debug C runtime library. So it may also be an OS feature, but most of the time, it's just the language runtime library.
Do malloc/new and free/delete work in the same way with regard to this?
The memory management portion of new and delete are usually implemented with malloc and free, so memory allocated with new and delete usually have the same features.
Is it platform specific?
The details are runtime specific. The actual values used are often chosen to not only look unusual and obvious when looking at a hex dump, but are designed to have certain properties that may take advantage of features of the processor. For example, odd values are often used, because they could cause an alignment fault. Large values are used (as opposed to 0), because they cause surprising delays if you loop to an uninitialized counter. On x86, 0xCC is an int 3
instruction, so if you execute an uninitialized memory, it'll trap.
Will it occur on other operating systems, such as Linux or VxWorks?
It mostly depends on the runtime library you use.
Can you give any practical examples as to how this initialisation is useful?
I listed some above. The values are generally chosen to increase the chances that something unusual happens if you do something with invalid portions of memory: long delays, traps, alignment faults, etc. Heap managers also sometimes use special fill values for the gaps between allocations. If those patterns ever change, it knows there was a bad write (like a buffer overrun) somewhere.
I remember reading something (maybe in Code Complete 2) that it is good to initialise memory to a known pattern when allocating it, and certain patterns will trigger interrupts in Win32 which will result in exceptions showing in the debugger.
How portable is this?
Writing Solid Code (and maybe Code Complete) talks about things to consider when choosing fill patterns. I've mentioned some of them here, and the Wikipedia article on Magic Number (programming) also summarizes them. Some of the tricks depend on the specifics of the processor you're using (like whether it requires aligned reads and writes and what values map to instructions that will trap). Other tricks, like using large values and unusual values that stand out in a memory dump are more portable.
This article describes unusual memory bit patterns and various techniques you can use if you encounter these values.
The obvious reason for the "why" is that suppose you have a class like this:
class Foo
{
public:
void SomeFunction()
{
cout << _obj->value << endl;
}
private:
SomeObject *_obj;
}
And then you instantiate one a Foo
and call SomeFunction
, it will give an access violation trying to read 0xCDCDCDCD
. This means that you forgot to initialize something. That's the "why part". If not, then the pointer might have lined up with some other memory, and it would be more difficult to debug. It's just letting you know the reason that you get an access violation. Note that this case was pretty simple, but in a bigger class it's easy to make that mistake.
AFAIK, this only works on the Visual Studio compiler when in debug mode (as opposed to release)
It's to easily see that memory has changed from its initial starting value, generally during debugging but sometimes for release code as well, since you can attach debuggers to the process while it's running.
It's not just memory either, many debuggers will set register contents to a sentinel value when the process starts (some versions of AIX will set the some registers to 0xdeadbeef
which is mildly humorous).
The IBM XLC compiler has an "initauto" option that will assign automatic variables a value that you specify. I used the following for my debug builds:
-Wc,'initauto(deadbeef,word)'
If I looked at the storage of an uninitialized variable, it would be set to 0xdeadbeef
'IT박스' 카테고리의 다른 글
'of'대 'from'연산자 (0) | 2020.07.15 |
---|---|
CSS만으로 이미지 회전식 슬라이드 쇼를 만들려면 어떻게해야합니까? (0) | 2020.07.15 |
자바에서 숫자를 단어로 변환하는 방법 (0) | 2020.07.15 |
파이썬에서 임시 디렉토리를 만들고 경로 / 파일 이름을 얻는 방법 (0) | 2020.07.15 |
오류 : 인수가 함수가 아니며 정의되지 않았습니다. (0) | 2020.07.15 |