Backport PR #64024 on branch 3.0.x (TST/CI: temporary xfail test_dataframe_from_series_or_index case for infer_string=False build)

Backport PR #64024 on branch 3.0.x (TST/CI: temporary xfail test_dataframe_from_series_or_index case for infer_string=False build) #6791