Cut bell peppers in half lengthwise; discard seeds and membranes. Place pepper halves, skin sides up, on a foil-lined baking sheet; flatten with hand. Broil 10 minutes or until blackened. Place in a zip-top plastic bag; seal. Let stand 10 minutes. Peel and chop.
Sprinkle chicken with salt and black pepper. Heat 1 teaspoon oil in a large nonstick skillet over medium-high heat. Add chicken; cook 5 minutes on each side or until done. Remove from pan; keep warm.
Add 1 teaspoon oil, rosemary, and garlic to pan; sauté 30 seconds or until garlic begins to brown. Stir in bell peppers, olives, and lemon juice; cook 1 minute or until thoroughly heated, stirring constantly.