If using Android 2.2 and above (which is most devices now), the following code will get you what you want.
@Override
public void onBackPressed() {
if (webView.canGoBack()) {
webView.goBack();
} else {
super.onBackPressed();
}
}