d18b05eaf4
avoid redundant checks for large realloc
2018-10-06 13:31:16 -04:00
eb7ced7781
implement in-place growth of large allocations
2018-10-06 13:24:22 -04:00
3dc49f8f73
slightly improve sized deallocation error messages
2018-10-05 01:06:12 -04:00
dcd969ae04
use a consistent style for fixed-size int types
...
The stdint.h types don't cover 128-bit integers and the underscore makes
them ill suited to usage in function suffixes. Instead, use the common
naming style in the Linux kernel and elsewhere including the ChaCha8
implementation included here.
2018-10-04 15:17:11 -04:00
642eed81c0
allow using larger guards on large allocations
2018-10-04 02:58:24 -04:00
5811bd184c
avoid unnecessary preprocessor use for canary mask
2018-10-03 17:17:20 -04:00
b24569b6ca
zero leading byte of canaries
2018-10-03 17:09:57 -04:00
cf449b3df4
add sized deallocation support
2018-09-19 13:05:12 -04:00
82314f4471
make get_size_info straightforward for zero size
2018-09-11 14:51:36 -04:00
7a404ddbf2
optimize size calculation for 16 byte spaced sizes
2018-09-11 14:46:44 -04:00
2d6ad18aa4
make function naming a bit more consistent
2018-09-11 14:18:13 -04:00
684291bf6a
avoid overhead of init check for slab deallocation
2018-09-11 14:13:43 -04:00
ef098fea06
simplify init function
2018-09-11 14:12:27 -04:00
61684925e8
fix overly naive slab allocation alignment support
2018-09-10 19:01:11 -04:00
9a1acce5eb
optimize calloc when zero on free is disabled
2018-09-07 16:33:28 -04:00
7ae7abedea
mark more unlikely code paths
2018-09-07 02:53:15 -04:00
49af83a817
wrap mutex type to enable future optimization
2018-09-07 01:13:08 -04:00
fc2473e7ee
add configuration for canaries
2018-09-07 00:35:08 -04:00
96c538d90f
add configuration for zero on free
2018-09-07 00:33:51 -04:00
ba3a8b0058
add slot randomization to configuration header
2018-09-07 00:25:02 -04:00
bed303a76f
remove unnecessary else branch
2018-09-07 00:22:51 -04:00
d398384b90
add header for configuration
2018-09-07 00:17:31 -04:00
99d68238d2
implement slab allocation write-after-free check
2018-09-07 00:00:32 -04:00
684e63a878
handle pthread_atfork calling into malloc
...
This results in compatibility with the malloc replacement support added
in musl 1.1.20.
2018-09-06 19:48:00 -04:00
1be74ec40d
add initial guard slabs implementation
2018-09-06 18:55:24 -04:00
cc1e79fdba
abstract metadata allocation to allow guard slabs
2018-09-06 18:45:41 -04:00
d8e18e0011
aligned_alloc is now the same as BSD memalign
...
The resolution to DR 460 (which is explicitly included in C17) removed
the requirement for the size to be a multiple of the alignment.
2018-09-06 16:30:22 -04:00
0d3c2e1988
no need for a dedicated init rng
2018-09-06 16:02:25 -04:00
8624201f06
refresh canary value when allocating free slabs
2018-09-06 15:07:01 -04:00
a875951e82
fix build with musl
2018-09-06 14:35:08 -04:00
e891b40588
implement Android malloc_disable/malloc_enable API
2018-09-06 14:17:23 -04:00
3a532b17dc
implement in-place shrinking for large allocations
2018-09-05 07:37:26 -04:00
645209dcbf
remove unnecessary debugging code
2018-09-05 03:42:05 -04:00
9ddd53d56c
implement initial slab allocation canaries
2018-09-04 09:29:35 -04:00
1a7b8079d0
reuse is_init when possible
2018-09-02 19:58:57 -04:00
7733047c7b
trigger early initialization in a conservative way
2018-09-02 19:52:12 -04:00
7e088dc870
add stubs for Android extensions
2018-09-02 05:08:45 -04:00
e4648192c0
split out code for managing page spans
2018-09-02 02:03:39 -04:00
e93d039214
only use reserved memory for regions hash table
2018-09-01 10:23:06 -04:00
c3a4829d77
remove unnecessary special case from realloc
2018-09-01 02:42:33 -04:00
f441dfe2e3
align size class metadata to cacheline size
2018-08-31 23:10:26 -04:00
fad10ce943
use FIFO queue for free slabs
2018-08-31 22:55:49 -04:00
3f80895822
ignore pad argument to malloc_trim per glibc
...
The pad argument is only used by the main arena for sbrk in glibc, with
every other page size gap purged with MADV_DONTNEED. It makes more sense
to simply treat it as an ignored legacy parameter rather than trying to
come up with a sensible way to use it for keeping cached free slabs.
2018-08-30 09:36:46 -04:00
1ea997b887
add missing headers to malloc.h
2018-08-30 08:48:43 -04:00
2b0f7aa985
use a consistent name for size class integer index
2018-08-30 07:13:28 -04:00
0f5f2bf6c9
add basic initial heuristic for freeing slabs
2018-08-30 06:56:00 -04:00
456dfe4154
add support for purging and protecting empty slabs
2018-08-30 05:59:44 -04:00
bb176e09bc
remove useless code in the empty_slabs path
2018-08-30 05:45:03 -04:00
29df2429c2
empty_slabs will remain a singly-linked list
2018-08-30 05:27:51 -04:00
f94068ea63
rename free_slabs to empty_slabs
2018-08-30 04:55:39 -04:00
b6d4af872f
move libdivide.h to third_party/libdivide.h
2018-08-30 03:03:19 -04:00
6f9de3e667
add inline hint to get_size_info
2018-08-29 15:13:53 -04:00
e85c69a0a4
fix builds with prefix
2018-08-29 15:07:36 -04:00
becadc57a5
get rid of unused MIN_ALIGN definition
2018-08-29 14:18:45 -04:00
2684a98eab
add initial malloc_object_size extensions
2018-08-29 14:18:42 -04:00
0e2f3d1015
sanity check page size at runtime
2018-08-29 11:00:18 -04:00
d779d41721
wrap more memory mapping implementation details
2018-08-29 10:57:42 -04:00
1cb28531a8
add wrapper for mremap with sanity check
2018-08-29 10:43:54 -04:00
5bc6820c24
rely on mmap rounding to page size when possible
2018-08-29 03:25:00 -04:00
58d929c0f0
split out low-level memory mapping wrappers
2018-08-29 00:53:38 -04:00
8b42e8c3d6
make sure errno is always set on failure
2018-08-28 22:49:11 -04:00
66aa98dbd9
sanity-check mmap errno on failure too
2018-08-28 22:41:18 -04:00
705b6a4f8d
make non-out-of-memory mprotect errors fatal
2018-08-28 22:22:57 -04:00
19c46d16f1
check pthread_atfork return value
2018-08-28 21:31:20 -04:00
803811a6ac
add support for using mremap
2018-08-28 10:44:04 -04:00
718bf82f96
add inline hints for slab_allocate and slab_free
2018-08-27 09:29:30 -04:00
33f862ec19
add inline hints for init and enforce_init
2018-08-27 09:29:27 -04:00
67b9608ccf
avoid duplicated init code calculating slab size
2018-08-27 09:22:04 -04:00
c7b24f63f1
use libdivide for substantially faster division
2018-08-27 07:07:48 -04:00
63b0c39343
reorder size_class struct for better performance
2018-08-27 05:21:58 -04:00
14ca7d7c3f
randomize large allocation guard size
2018-08-26 04:46:12 -04:00
a13a45a17d
hold regions_lock in alloc_aligned
2018-08-26 04:37:43 -04:00
2b7c9362bb
consume fewer random bytes for slab randomization
2018-08-25 18:32:44 -04:00
c5d76179a5
improve interaction of slot rand with slot mask
2018-08-25 18:04:55 -04:00
173dd6e7a5
randomize slot selection for empty slabs too
2018-08-25 18:02:13 -04:00
c335c43dd7
simplify slab out-of-memory error handling
2018-08-25 16:41:07 -04:00
7bcfa3f08b
tune slab metadata allocation
2018-08-25 15:46:22 -04:00
4777ee0c85
special case division for page size slabs
2018-08-25 15:21:50 -04:00
ec78add6ab
define ffzl utility function
2018-08-25 03:14:07 -04:00
f08d4d31db
randomize slab slot choice
2018-08-25 03:02:39 -04:00
965c3202b4
finish implementation of zero byte size class
2018-08-25 02:48:47 -04:00
f97a0ef8b1
use a more appropriate type for masked bitmaps
2018-08-25 01:09:15 -04:00
f3c8502509
add CSPRNGs for regions and slabs
2018-08-25 00:25:33 -04:00
805bdc6087
add an extra sanity check for unallocated metadata
2018-08-24 05:22:38 -04:00
2d168b0516
check for double free slightly earlier
2018-08-24 04:51:52 -04:00
97b693d862
stop treating guard size as a constant
2018-08-24 04:07:46 -04:00
83dabbd8fa
fix handling of random bases for class regions
2018-08-24 03:52:01 -04:00
0d51459dc9
add a special memory protected 0 byte size class
2018-08-24 03:24:23 -04:00
7a86b67778
add unaligned free check for small allocations
2018-08-24 02:55:53 -04:00
2aee424b7b
fix inconsistent whitespace
2018-08-24 02:09:20 -04:00
a874a61099
adjust slot count for 12288 byte size class
2018-08-23 18:00:13 -04:00
127f110126
adjust slot count for 10240 byte size class
2018-08-23 17:56:17 -04:00
c59c97c65b
adjust slot count for 48 byte size class
2018-08-23 17:53:10 -04:00
56e4c7e042
adjust slot count for 224 byte size class
2018-08-23 17:42:51 -04:00
4aa0fab4f4
avoid deadlocks after forking threaded processes
2018-08-23 17:22:12 -04:00
70d61b6662
initial commit
2018-08-23 15:42:41 -04:00
Daniel Micay