Yes those are pilot lights and this is perfectly normal in fact only be concerned if they are not lit. This is just a fact of life with gas ovens. Little bit spooky huh? That's why I have always preferred electric ranges but gas is preferred by many.