Yes it is your igniter or Glow bar as we call them easy to replace, just make sure you use ceramic nuts when replacing it, they are heat resistant.

Hi,
Here is a tip that I wrote that will help you with that problem...

The ignitor for your burner has failed...
Yeah it sounds crazy, but read this..
http://www.fixya.com/support/r3663023-oven_not_working_or_oven_not_heating

heatman101