{"id":77,"date":"2013-12-30T03:20:24","date_gmt":"2013-12-30T03:20:24","guid":{"rendered":"http:\/\/www.eminozlem.com\/?p=77"},"modified":"2015-11-23T10:06:47","modified_gmt":"2015-11-23T10:06:47","slug":"the-server-quit-without-updating-pid-file-and-all-that-jazz","status":"publish","type":"post","link":"https:\/\/eminozlem.com\/tr\/the-server-quit-without-updating-pid-file-and-all-that-jazz\/","title":{"rendered":"The server quit without updating PID file and all that jazz."},"content":{"rendered":"

The story:<\/strong>
\nI was getting session file write errors (write failed: No space left on device (28)<\/em> ) in wp admin, i checked \/tmp<\/strong> folder but it was not full<\/strong>, only 60% percent was used. So not being able to pinpoint what the problem was, i thought a reboot would be a good idea. But everything went straight to hell from there. The reboot returned with a “Error establishing a database connection<\/strong>“, so i went on to restart mysql. Needless to say it failed. While i was at it, i decided to upgrade mysql to 5.5 – but i dont know if that made matters worse, or effected it in any way.
\nI kept getting ‘unrecognized service’ errors for mysql<\/strong> and mysqld <\/strong>in my restart attempts. Which made absolutely no sense because i was damn sure mysql was installed since i had a properly running server 10 minutes ago.<\/p>\n

Despite the fact that i was unable to start mysql, i was still able to access phpmyadmin. My tables seemed to be corrupt but i could not neither check or repair them. They were marked as #Unknown Storage Engine innodb<\/strong> & in use<\/strong>.<\/p>\n

Turns out; all the problem stemmed from \/tmp running out of ‘inodes<\/strong>‘.But we’ll get to that.<\/p><\/blockquote>\n

Before i figured that out, i tried a lot of things. I removed(renamed) the host.domain.pid<\/strong> & ib_logfile1<\/strong>, ib_logfile2<\/strong> files in var\/lib\/mysql. <\/em>At this point i started to get The server quit without updating PID file<\/strong> errors. Google searches suggested restarting mysqld<\/em> and it’d be taken care of, but i wasnt able to do that already. When i figured i was out of inodes by doing a #df -i <\/strong> as in the picture, i wondered what wore them out and found out it was eaccelerator.<\/strong> So i’ve cleaned up \/tmp\/eaccelerator<\/strong> folder and moved it to \/var\/cache\/eaccelerator, and defined it in php.ini as eaccelerator.cache_dir=”\/tmp\/eaccelerator” <\/strong>. Cleaning out the inodes, i was able to start mysql now. But my troubles wasnt done yet.<\/p>\n

I had a highly customized my.cnf<\/strong> and thought something might be conflicting. It didnt make any sense for a conflict to appear out of the blue, but to my surprise, something was. But i was already tired by now and definitely wasnt in the mood to go over tens of my.cnf lines to pinpoint the problematic line. So i chose one of the defaults inside \/usr\/share\/mysql\/<\/strong> . Dont worry, these mysql configs are specifically generated for your server so you should be fine, just pick one that suits you (i picked the most suitable one for me: #DESCR: 4GB RAM, few connections, heavy queries).<\/p>\n

I don’t know if it was the 5.5 mysql upgrade or something else i did along the way, but when i try to go in phpmyadmin, i was rejected with a #2002 Cannot log in to the MySQL server while trying to connect to phpmyadmin <\/strong>& now i was welcomed by a shocking “wordpress install” page. Oddly enough, i had to reconfigure my phpmyadmin config & accordingly wp config. Had to change connection type of phpmyadmin from tcp to socket and change “localhost” to “127.0.0.1” and again localhost to 127.0.0.1 in wp-config to reflect the changes.<\/p>\n

Yeah, so that’s all, those are what i ended up having to do. Maybe if i noticed i was out of inodes in the beginning, i wouldnt have to change a thing (other than the eaccelerator cache folder), eh, what you gonna do.. live & learn.<\/p>\n

Problems:<\/strong>
\nIf your WordPress defaults-reverts to install screen<\/strong>
\nif you get wp error: Error establishing a database connection<\/strong>
\nIf your tables are marked #Unknown Storage Engine innodb<\/strong> or ‘in use<\/strong>‘ in phpmyadmin,
\nif you cannot start mysql<\/strong>
\nIf you get mysqld: unrecognized service<\/strong> or mysql: unrecognized service when trying to start\/restart them.
\nIf you get #2002 Cannot log in to the MySQL server while trying to connect to phpmyadmin.
\n<\/strong>If you get WordPress database error: [Can’t create\/write to file ‘\/tmp\/#sql_xxxx.MYI’ (Errcode: 28)]<\/strong><\/p>\n

Causes:<\/strong>
\nYour \/tmp is full (the fact that it has unused space doesnt mean it’s NOT FULL<\/strong>. It might have run out of inodes<\/strong> – read above)
\nYour phpmyadmin configuration is wrong.
\nYour wp-config is wrong.<\/p>\n

Solutions:<\/strong><\/p>\n

Make sure your \/tmp folder is not full BOTH in terms of space & inodes.
\nIf you are sure of that, check your my.cnf and try loading one of the default ones, see if that solves it.
\nCheck your phpmyadmin config & your wp-config complies with it.<\/p>\n","protected":false},"excerpt":{"rendered":"

The story: I was getting session file write errors (write failed: No space left on device (28) ) in wp admin, i checked \/tmp folder but it was not full, only 60% percent was used. So not being able to pinpoint what the problem was, i thought a reboot would be a good idea. But…<\/p>\n","protected":false},"author":1,"featured_media":78,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[18,2],"tags":[19,22,21,20,68],"class_list":["post-77","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","category-wordpress","tag-mysql","tag-phpmyadmin","tag-server","tag-ssh","tag-wordpress"],"acf":[],"_links":{"self":[{"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/posts\/77","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/comments?post=77"}],"version-history":[{"count":0,"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/posts\/77\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/media\/78"}],"wp:attachment":[{"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/media?parent=77"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/categories?post=77"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eminozlem.com\/tr\/wp-json\/wp\/v2\/tags?post=77"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}