Preheat oven to 375°.
To prepare potatoes, place potatoes in a 13 x 9-inch baking dish. Drizzle with water; sprinkle with salt and pepper. Cover with aluminum foil; bake at 375° 55 minutes or until tender. Uncover and cool 5 minutes. Cut in half.
To prepare olive mixture, combine olive oil, bell pepper, and next 7 ingredients (bell pepper through garlic) in a large bowl. Add potatoes and cheese to bell pepper mixture; toss gently to combine.