Enable vi mode in irb, python shell, and other readline based systems:

cat <<END >>~/.inputrc
> set -o vi
> set editing-mode vi
> END

Now everything has vi key bindings! You are welcome.