245169a520bd69ddd0426fb3bffe5652e6753aef
By:
IsaacT8

Site Crashed - Unreadable Content within my Error Logs

September 26, 2015 596 views
Apache WordPress

So my site recently crashed and during the investigation process I entered the command:

cd /var/log/apache2
ls

and got this:

access.log error.log.15.gz error.log.2.gz othervhostsaccess.log othervhostsaccess.log.16.gz othervhostsaccess.log.3.gz
error.log error.log.16.gz error.log.3.gz othervhostsaccess.log.1 othervhostsaccess.log.17.gz othervhostsaccess.log.4.gz
error.log.1 error.log.17.gz error.log.4.gz othervhostsaccess.log.10.gz othervhostsaccess.log.18.gz othervhostsaccess.log.5.gz
error.log.10.gz error.log.18.gz error.log.5.gz othervhostsaccess.log.11.gz othervhostsaccess.log.19.gz othervhostsaccess.log.6.gz
error.log.11.gz error.log.19.gz error.log.6.gz othervhostsaccess.log.12.gz othervhostsaccess.log.20.gz othervhostsaccess.log.7.gz
error.log.12.gz error.log.20.gz error.log.7.gz othervhostsaccess.log.13.gz othervhostsaccess.log.21.gz othervhostsaccess.log.8.gz
error.log.13.gz error.log.21.gz error.log.8.gz othervhostsaccess.log.14.gz othervhostsaccess.log.22.gz othervhostsaccess.log.9.gz
error.log.14.gz error.log.22.gz error.log.9.gz othervhostsaccess.log.15.gz othervhostsaccess.log.2.gz

Naturally I was curious and so I gave this command:

nano other_vhosts_access.log.2.gz

and got this:
^^H^@ZU^@^CPKk^B1^P+-h6Y7jr^^*=^TAzRfM!7+^Vzaf^^]v{
Ѕld-ii˅^\^Zʅ;
?G^
>ɅtXх^D^Uea-^Rփ X7%Kxx;d#l7ۚ^SNČ[%^B:$
q(s^Lu<^XWE#F^ZH*H^R^?Űd^RXn^U[ITK.%)h?ڼ^O&# Qiua^DF^]$
^nײU6^Ad^H ^Բx/yy(6c,&-:^[ɲJH(^B^@^@

I looked into another log file and got this:
ST^^H^@@U^@^C]sȓ
]~$4^Oi$Rd^S;vY;r^M0Q0&^?^Hpx0^XcX{k ^Aَݎ ~M^Ou,DZ0-䱞ձ=ۨבa^Ñ^?kS ְ^]T' Mm'ǰ'g^Gǰ^
O^XﰞΰΰNjȲ^Xض^Ml㶞Ķx ᶞͮaZ̮$
Hz;X^WIg<F 6^E^VFc<?00"xޔQ^Ô^Q^WƔwޕӰH^WF7ϓz֓^Uab^Mԓ'^V<[^UYm 6L=|À݊^A:r^G^E0^HnƊⒷ^YI^GqV#뒷TlhHٛ^Z^Y6($
|| A'~^G<%~?SM~S
n~f|<3\^K0^^^?u^K#^Cboƾh^Zm+ݲ^W-jC^M+r^@_Duղ)v^FO^G{ hڲͲ۲ ^?`^E"~˱^HѱpƱ6S2=wjG^FWڱ}^^^L^[ϫ.̫IZ$
$xr^NkG\YWQ8è뎵(1Ύd^N厵Ύo[>쎵莸Hd#V4L ێed^Sl̎,ߎ^DԎˎ"6\掸ގ^C^WML^G^K8r.[f^^F^_편f;^Lĵё^C^FU^R^Vfm^Mꑸ쐭m^PsPZ^Kp$
L^Stк^S!غHe?6Kl^T}^]E ^S-ݺY[.Ă,^O^Eب\X$^Fݨ=٨v(eb=lܨ@'.RrWt^V%:SQ^QШy^N^PޔC^OAܔOM;^V!^Yn%ĔqI)LJ^X|ǵ1E$
6V<)Rn"^G=^H0o^M6q;^?^^^^t{і0cΖ^K1Ɩv^]9KkT;Oޖ^GΖ@d̖?e(ӖPqHh^\N֖^FǑFMDޑ^^Ñґˑ:Bב!H^[
Q^Lё$ݑ^M{$
^Y-Î l{^^E^Ex'"a ^E^L]Лϛ^O7ؼ^N ^^
Z^HOE^Up莎^[;Ύ=p莎Ύmg厎掎^G^GN7^Tr3^Rњ^^Oߚ^R X^Nxʤ^P^@&^N䤥 w^MZФ^Vf^P^Oͤ:^Ml^]nݤu ^Uz"0<դŤ Ф:$
=^^˸^Cĸ<=LٸݸӸ^Kef#BݒQ^MkP4S^?RJZ^WْUsߞ˨mĨƨ^Tc!<M9U^PǨB^VGϨިu~^^^V&^U;;WͨR^F^G %^Fw?iTW$b/]^^^D^Y^CVq^[$
J0g [^Ä^M#ӄ^Ss622OŌ݄^H1
Om^BFby^[!V^Ua^[װD^]!;~%5kܰ샯-⃯

^K^X^U2^VecIBU4^G^Pf7^O3LoƟݟTF^F ؟ʞ^X͞Ӟ[7dP l$B왏^]^Q^?^N-ę̙5\l#fc㙏+"5\,^U3nəș^Bݙrޙo!$
-^T3j8Q^^T:i^Mxg^LyOCKT/qgg+[wxZR-!AԳ7@%^Ucسس['(j
^Z#.Z^
"κ#Ժк#fs^P
^E"K^LѺ:5& -ʺsĈ^Ab9<)^Yވ2^[^T^WE- ]wִ^N^Ckɴw}<L^XJڴ;\^NܴB<z^Q{tٴ۴PŴ ?.N^YK!X.ڶ*a^$
^^F^VX4f`1D_e^\[x^?<ڟI; ?fǟ>ßß7Gӟ(ҟM^Wџ&woɱ{q^Q9DZϱ^['^^^^R~ġ{ҡ^P^S^]QKoG{^X^DK8סč^Y^D$
bb&+t 3I؍$ v0Ա^E:ɱyW^Vڱw:^Nq,Ah)̽"0ˣ^F0^F^Dn^W^Gꈅ6+ IWưL<l^L^?6O^Mﰅ^NsGG^^?ΰ27g!jӰL
(簅ă~$^[A$
R^Tef7ʨ)"vDܨ^\^@'Y"Lͨ^Fk0|¨l
n ^Uj^]^?E^\q3^AώP4UC7T3Lk^M+^O$B^NVI&ێf^DӍ6!ʍ)Ѝ~E\v.؍v=^?MD6>xu[SG^TaC^U(^Lƍ^@Yۍ^["w^M1{yg^H!^@^N6W^Fq3,Z"]dꥈ$$
^Xr^]a^G^G9/ZE!.ϕ^D}^Q^OVܕMp^Gث]櫍&^Q߫CU뫍*䫍ζp^^궍.۶۶9۶@2ȶeٶhN^T涍u#ᶍi϶춍 ^]^TfGĶ ^X^G}^^sӳ^\>TֳֳWO8ճ^Sw$
^NtRٕە?^_.j*HAK^O;^OXrǕP]ԕ^W^KLj^@Օ[^LҼ^P5^NJ8/i
EؼԼZԼ#^V>T0iǼ;eu^?Ǽ^?R?ռmټ3^T7QT^Hנ֠^AUkRĠ-Cq$
Ug^@wT Xo!^\^H6͕Õ^Ap͕(
ƵKؔpLܔ̔5ؔ@V߫ʫ{oyիO^o :'GkhyKva9ۖ^D[֖^XlʖJ-^WߖPUϖƖ}7TՖrrsCUtǗg^NYٗ˗3^X^Z"&ߗҗ6
dpHOsmeZf~M)+iv
ގaԾeվTSپ^Ti M{L۾1^]ҾӾ܋^Arˬj.zլ亐꺐˺^L~^V:R5k\z:t4y\F-zO|!^^SкppQ\8ܺIvɺq0^O,(^{̺m0y^\D\6yi亐馽c8^Yu^Y$
=#C^X^G:Ub2^^(Ip"]v]hnu^T=xp^F^S;AjbJ^Et^O^Zڰ/^G^At+Ȱp^KEqghB~^MհΰI&^X``^S?9Ztq^Tk\g$
^M^TTyˌwn^T7{^U^CG^F~'X8~g8^Um@Dja&Y^[^[eh#ڌŌm?^Z^ZYЩmSȲ-R)v#pk:E8̲вr
+sHa^Cl^D:y^El$
^M}x^?y@KVEPl^X6,p^X(r^MR.^S=ԕ|^WKΕPmɕ^DŕEPJ(!~ͦ^Z>QƦ?3q%^DĦ^U?^VզɦϦo^TrħHL[Sꊖ0g^?z^$
v^CO@Ѯ^^[ȫ+^SC^TyX=bD^MYƫfo
x^@[^^A !^AnϫzjӾ1v^[}1>taH^]S;10 ^M@^K 6I^Oj^U7]^C4z^D^Ⱦξ^Mž^Y$

yX^C^ZZ^C~$TEFL1Nh^O\3^G^P^Z^S9;5^^^BkUQU>z^Wy~yIdQ'ʻw%jv̓ȓt[+D̓_,9^@vD]z=Lܐl^O^VאfvD^[6Lb

f2j͎oю$^QW؎.e ^HFێ^^;%o^D^[^Hю쌆BʌLĔ͔ŔLn!l¶ȶEnԶCOǶ^[Ѷ^X^MM^Ö 聆^YB^M-^F1Ӂ0=݁^Of6&e^KĩŰ)^DȰϰ将^F^\ư^C^[ºƺ^LPx$S^M;aV꺆Rm$
vA=[s^G^SogRbUs^G}rn{Oh^Fa<oO^L^H^EJ
fx\9EF^Sګ815̲j5[?ȲშWdڃ^@^C~^U^Gm^_!zmɃ-SKꃨ,^^PH:NK{^@aރ,-^Ft^?5ՃL;#bك dy^\惨58ɑS6"呱H{0B^Zꋜ $
=x^Kz^]%&MAS]^K6]ooOd檂^KX^E,۪y^Fvn^Hso&ªVm~|X:^L^Tƪ^NA몂C^U'$1G#^YTKΪYgU8X|.X٪ɪ
^NqgWNRH:m^PpjKCwW1<+^[6H`*8f".ٖT^Z#Kf)4Uʖ̲<xSP[8?i^Pٲ^Q"MdѲYqŲ_?O^[T^]Rd^D̲g}(Z!^YvˬB֬ج Ұ^@^D^[e$
fa^WHX\bǭŭ^F3e˭;^MeS Aʭ]lcܹ{^Nȹv^W ?˹^PƹYzsc^CǾnԾjK-3ʥ^O^X>^B/Υ>'T^AS#X<
^Vv^^H^L$^CX^U~x|
^?d2q>-ep^E24-aED,^N^F3d^;ۭZƭz^CU^UDד^Oև^N ^Ml^R^YK'^A^Eˇ!qHNч1h0^2Ƈ8ԇT^Ta$
"
^K)^C.^K^@.5W&nJ4Y/^NMʐ`Lk^W߮^B^TtӮr.U̮x.g֘gvoڔ)^TܔOك"D%^X9/փXS2F^ÃWEރ^H^Z^Hi^Kd҃fM"Ă^Vڂ^V2˂tt$
[^SL^^d^NI^U^TMSTx^Xp1usQ^P35&vDA(jFmRoTs$H ւĂ&҂^Y7^ZFy]^L6^DւK'^LI^G^Fr?̵f0^X^SL^$
K^^1h-^?^P('O<#Hj
zOWԐQ^K[^ÐRrB
B^FIW,=~mIm@^[ZS=ټu^BZjڼYμҼZYҼ^E=ռ,v^X(@O,˼%|y-˼^B%jּ҈mv]X_-IЈd݈:EPZ.(ֵE9YQZG[Z^R*^Lю;;^Yˎ^STF2

Obviously, I am confused and have no real idea what caused the site to crash. I am concerned that since the log files are unreadable whatever caused my site to crash will make it happen again.

I was able to reboot the droplet and now the site is back up... for now.

1 comment
  • I received this response directly from a Digital Ocean Support Team Member:

    I see that you tried to open one of those access logs in the nano text editor, which would normally work fine. However, files ending in ".1.gz", ".2.gz", and so on are not quite the plain text files that you're expecting. The number indicates log files that have been rotated (backed up) from their original file, and the ".gz" indicates a compressed file.

    For readable information, you'll want to run a command like nano error.log, which is the base error log file, instead of nano error.log.10.gz which has been backed up and compressed.

1 Answer
Have another answer? Share your knowledge.