Heat grill to medium.
Remove the ends and any tough strings from the celery. Cut each celery stalk in half crosswise. Place the celery, oil, salt, and pepper in a large bowl; toss. Grill, turning occasionally, until slightly tender but still firm, 4 to 6 minutes total. Remove from heat. Top each stalk with 2 teaspoons of the blue cheese.