HACKS VITAE

CHECKED · PROPERTY TOOLS

AI Property Tools
What They Can and Can't Tell You, Checked

PRICES, VERSIONS AND FACTS AS OF OCTOBER 2026

What automated home valuations and AI deal-finding tools can and can't tell you: published error rates, the US rule for lenders' models, a bias study, Zillow Offers, and what the FTC says about income claims.

HOVER A GLOWING POINT · DRAG TO TURN
  • Doesn't hold up 4
  • Partly 1
  • Holds up 1
  • Can't confirm 2
Published
October 1, 2026
Facts as of
October 2026
Read
10 min
points
8

BACKGROUND · REMBRANDT, HERMAN DOOMER, 1640 · THE MET, OPEN ACCESS

THE SHORT VERSION

  1. An automated value is an estimate, not an appraisal: Zillow says its Zestimate "is not an appraisal", and publishes a nationwide median error of 1.79% for homes on the market and 7.20% for homes that are not. A median means half of the estimates miss by more.
  2. Lenders' models are now regulated in the US; investor tools are a different matter: since 1 October 2025 a US rule has required quality controls on the automated valuations lenders use for mortgages on a consumer's principal dwelling. Separately, a 2024 study in a HUD journal, using 2018 home sales in two US metro areas, found larger percentage valuation errors in majority-Black neighbourhoods.
  3. Forecasting is harder than valuing: Zillow decided in November 2021 to wind down its home-buying business, saying its price forecasts had missed "by much more than we modeled as possible". We found no independent test showing that AI deal-finding tools pick better deals than people do.
  4. Income claims are what the FTC has named: the FTC treats false claims that profits are typical, or that no experience is needed, as unlawful, and when it announced Operation AI Comply in 2024 its chair said "there is no AI exemption from the laws on the books." Nothing here is financial, investment or legal advice.

What we found

Our reading of the evidence on each of the 8 points, with where it comes from. Open any row, look at the source, and make up your own mind.

Doesn't hold upAn AI home valuation is as good as an appraisal

Zillow, which publishes one, says it is not. Zillow writes that the Zestimate "is not an appraisal and can't be used in place of an appraisal", and that it cannot be used to get a loan. The US rule for lenders' models keeps the two apart too: it does not apply to the development of an appraisal by a certified or licensed appraiser.

SOURCE Zillow, "What is a Zestimate?" (read 1 October 2026); 89 Fed. Reg. 64538 (7 August 2024).

PartlyOnline home-value estimates are accurate to within a couple of percent

For homes listed for sale, at the median; not for the rest. Zillow puts its nationwide median error at 1.79% for homes on the market and 7.20% for off-market homes. Half of the estimates miss by more than the median, and Zillow says accuracy varies by location and property.

SOURCE Zillow, "What is a Zestimate?" (read 1 October 2026).

Doesn't hold upAutomated valuations take human bias out of home values

Not in the evidence we found. A 2024 study published by HUD, using 2018 sales in parts of the Atlanta and Memphis areas, found larger percentage errors in majority-Black neighbourhoods, and the gap remained after the authors accounted for property condition with machine-learning methods. US regulators cited concerns that these models can replicate "historical patterns of discrimination". One study of two areas cannot say how large the gap is elsewhere.

SOURCE Zhu, Neal & Young, Cityscape 26(1), 2024; 89 Fed. Reg. 64538 (7 August 2024).

Doesn't hold upAutomated valuations used for US mortgages are unregulated

Not now, and not entirely before. US bank and credit-union regulators have given the institutions they supervise guidance on these models since 2010, and since 1 October 2025 a rule from six US agencies has required lenders and secondary-market issuers to have quality controls on the models they use to value a home securing a mortgage on a consumer's principal dwelling. It covers lenders' use, not values shown on websites or in investment tools.

SOURCE 89 Fed. Reg. 64538 (7 August 2024); eCFR, 12 CFR part 34, subpart I.

Holds upZillow shut down its home-buying business because its price forecasts missed

That is the company's own account, with other reasons beside it. Zillow's filing gave "home pricing unpredictability, capacity constraints and other operational challenges", and its shareholder letter said it had been "unable to accurately forecast future home prices" by much more than it had modelled as possible.

SOURCE Zillow Group, Form 8-K and shareholder letter (2 November 2021).

Can't confirmAI tools can find property deals that people miss

We found no independent test. What we found were vendors' own case studies and review lists. That does not show the tools fail; it means the claim has not been tested in public in anything we could find.

SOURCE Our search, 1 October 2026 (see the section on deal-finding tools).

Can't confirmThe income shown in an ad is what a typical buyer makes

An ad's own figures can't tell you that. The FTC's advice is to read success stories and testimonials with skepticism, because "they might not be true or typical", and its cases found it unlawful to falsely claim that represented profits are typical.

SOURCE FTC, "When a Business Offer or Coaching Program is a Scam"; FTC press release (26 October 2021).

Doesn't hold upCalling a product AI-powered exempts it from the usual rules on claims

The FTC says not. Announcing five law enforcement actions in September 2024, its chair said: "there is no AI exemption from the laws on the books."

SOURCE FTC press release, Operation AI Comply (25 September 2024).

THE ARTICLE · 10 MIN

Software now exists that values homes, scans listings and runs the rental maths, and some of it is sold with “AI” in the name. This page is about that kind of tool in general. In it, an “AI property tool” means something that does some mix of three jobs: estimating what a home is worth, finding listings (including foreclosures and homes that are not for sale), and working out rent, costs and loan cover. For each job, it looks at what the published evidence says, and it ends with questions you can ask of any such tool.

Nothing here is financial, investment or legal advice. For a decision about a property or a loan, speak to a licensed professional where you live.

What an automated valuation is

A study published in 2024 by the US Department of Housing and Urban Development describes an automated valuation model, or AVM, as “a computer-driven mathematical formula that uses property characteristics, local market information, and price trends to arrive at an estimated value for a property”.

Zillow’s Zestimate is one example, and Zillow publishes how it works and how often it misses. It says the Zestimate “incorporates public records, MLS data and user-submitted home details” into its own valuation model, which it describes as neural-network based. It also says Zestimates “are available only for residential properties”: large multi-family buildings, vacant land and commercial properties are not eligible.

How accurate the estimates are

Zillow states: “The nationwide median error rate for the Zestimate is 1.79% for homes that are on the market and 7.20% for off-market homes.” It explains what a median means here: for listed homes, the estimate is within 1.79% of the final sale price “half of the time”. The other half of the time, it is further off.

The company gives a reason for the gap. Listed homes have more up-to-date information, “including listing details and recent market activity”. In its table for listed homes in large metro areas, last refreshed on 16 September 2026, the median error runs from 1.18% in Raleigh to 2.56% in New York.

Two things follow from Zillow’s own figures. A home that is not for sale falls in the off-market group, where the median miss is about four times larger. And a percentage turns into money quickly: on a $300,000 home, a 7.20% miss is $21,600. Neither figure tells you how far off the estimate is for any one home. Zillow explains how it measures them: for listed homes it uses the last Zestimate before the home goes under contract, which already draws on the listing, and for off-market homes it counts “only homes that eventually sell”.

Zillow also says the Zestimate leaves out foreclosure sales, because its analysis found that they “are generally made at substantial discounts compared to non-foreclosure sales”. The Zestimate is meant to estimate the price a home “would fetch if sold for its full value”. That is a different question from what a foreclosure will sell for.

An estimate is not an appraisal

Zillow is direct about this: “It is not an appraisal and can’t be used in place of an appraisal.” Asked whether a Zestimate can be used to get a loan, its answer is no, adding that “most lending professionals and institutions will only use professional appraisals when making loan-related decisions”. It suggests visiting the home, a professional appraisal, or a comparative market analysis from a real estate agent.

The US rule described next draws the same line. It does not apply to the use of AVMs in “the development of an appraisal by a certified or licensed appraiser”.

The US rule for lenders’ automated valuations

Six US agencies (the OCC, the Federal Reserve, the FDIC, the NCUA, the CFPB and the FHFA) published a final rule on 7 August 2024 setting quality-control standards for AVMs. It took effect on 1 October 2025, and the federal eCFR listed its sections as in force when we checked on 1 October 2026.

Lenders and secondary-market issuers that use an AVM to value a home securing a mortgage must have policies and controls so that the model meets standards designed to:

  • “ensure a high level of confidence in the estimates produced by AVMs”;
  • “protect against the manipulation of data”;
  • “seek to avoid conflicts of interest”;
  • “require random sample testing and reviews”;
  • “comply with applicable nondiscrimination laws”.

The rule does not prescribe how. The agencies point to “the flexibility provided to institutions under the final rule to design policies, practices, procedures, and control systems”.

Its scope is narrow. It covers mortgages “secured by a consumer’s principal dwelling”, and a consumer can have only one principal dwelling at a time, so “a vacation or other second home would not be a principal dwelling”. It is a rule about the models lenders use, so by its own definitions it does not set a standard for a value that a website or an investment tool shows you.

Bias: what one study found

In the rule’s background section, the agencies wrote of “increasing concerns about the potential for AVMs to produce property estimates that reflect discriminatory bias, such as by replicating systemic inaccuracies and historical patterns of discrimination”.

A study in HUD’s journal Cityscape in 2024, by Linna Zhu and Michael Neal of the Urban Institute and Caitlin Young of Yale Law School, tested this in counties of the Atlanta and Memphis areas. The authors note the hope that AVMs would help with appraisal bias by “eliminating the appraiser’s input”. They added data on each property’s condition and used machine-learning methods, and still found “evidence that AVMs yield larger valuation errors in majority-Black neighborhoods”. Condition mattered too: in one of the study’s regressions, a home rated poor rather than good had an error larger by 4.35 percentage points.

The gap is in percentage terms. In the study’s figures for 2000 to 2018, errors measured in dollars were mostly smaller in majority-Black neighbourhoods, where average home values were lower. This is one study, whose main analysis uses 2018 sales in two metro areas. It shows that a gap in percentage errors remained after the authors accounted for property condition; it cannot say how large the gap is elsewhere, today, or for any particular tool.

Valuing today is not forecasting tomorrow

On 2 November 2021, Zillow’s board decided to wind down Zillow Offers, the company’s business buying and selling homes. Its filing gave the reasons as “home pricing unpredictability, capacity constraints and other operational challenges”, and recorded a $304.4 million write-down on homes bought “at higher prices than Zillow Group’s current estimates of future selling prices after selling costs”. It expected the wind-down to cut its workforce by about 25%.

Zillow’s shareholder letter that day said the business rested on “the need to forecast the price of homes accurately three to six months into the future”, and a few sentences later: “We have been unable to accurately forecast future home prices at different times in both directions by much more than we modeled as possible.” The chief executive, Rich Barton, said “the unpredictability in forecasting home prices far exceeds what we anticipated”.

The same letter names a pandemic and an unprecedented rise in prices as part of the story, so this is not proof that prices can never be forecast. It is a company with its own valuation model explaining why its forecasts were not good enough to run that business. A valuation estimates today’s price; a deal often depends on tomorrow’s.

What deal-finding tools do, and what is known about them

Of the three jobs, the third is mostly arithmetic. One calculation such a tool may run is the debt service coverage ratio, or DSCR. The OCC’s handbook for bank examiners says the DSCR is “calculated by dividing the NOI by the annual debt service requirements”, where net operating income is “annual gross income less operating expenses”.

The formula is simple, and so are its limits. The ratio is only as good as the rent, the expenses and the loan terms put into it. If the rent is itself an estimate, any error in it carries straight into the result.

Do the AI parts find better deals than a person would? We looked for an independent test, a study comparing what such tools picked with how those deals turned out, and found none. What we found were vendors’ own case studies and review lists. That does not show the tools fail. It means the claim has not been tested in public in anything we could find.

What US regulators say about money-making pitches

In October 2021 the US Federal Trade Commission sent a notice to more than 1,100 businesses that pitch money-making ventures. It summarised earlier cases finding it unlawful to make false or misleading claims about earnings, “for example, representations that participants will make a profit, or that represented profits are typical”. It also listed “falsely telling consumers they do not need experience to earn income or that they must act immediately to participate”. Penalties at the time were up to $43,792 per violation; after yearly inflation adjustments, the maximum in force when we checked in October 2026 was $53,088.

The FTC’s consumer advice puts it plainly: “If it promises guaranteed income, large returns, or a ‘proven system,’ it’s likely a scam.” On real estate seminar and investment coaching scams, it says such schemes “routinely use made-up ‘stories’ and statistics, claim a guaranteed return on your investment, or stress how cutting-edge their offer is”. On success stories: “They might not be true or typical.”

On 25 September 2024 the FTC announced five law enforcement actions under the name Operation AI Comply. They were about a tool for writing fake reviews, an “AI lawyer” service, and “multiple companies claiming that they could use AI to help consumers make money through online storefronts”, not about property. In one, the FTC alleged that a scheme “falsely claimed its ‘cutting edge’ AI-powered tools would help consumers quickly earn thousands of dollars a month in passive income”. These are the FTC’s allegations; the case it filed in court is for the court to decide. The FTC’s chair at the time, Lina M. Khan, said: “there is no AI exemption from the laws on the books.”

Questions to ask of any property tool

These are questions, not advice. The answers are yours to weigh, with a licensed professional where the money is large.

  1. Where does the data come from, and how fresh is it? One large property site, for example, names its inputs and says it refreshes its estimates “multiple times per week”.
  2. Is the number an estimate or an appraisal? An estimate shown on a screen is not an appraisal. A lender using a model to value a home for a mortgage on someone’s principal dwelling falls under the rule above.
  3. Does it publish its error rate, for listed and unlisted homes separately? At least one large site publishes both, and the gap between the two is the useful part.
  4. Are the income figures typical, and what are they based on? The FTC suggests asking questions such as “How would the business generate income? What would my specific expenses be? Can I afford it? When would I expect to turn a profit?”
  5. If it offers or arranges loans, who is licensed? In the US, companies and individuals that originate mortgages must be licensed or registered through the Nationwide Multistate Licensing System, and anyone can check status on NMLS Consumer Access. For investment professionals, FINRA’s BrokerCheck links to the SEC’s adviser database. These are US registers; other countries keep their own.
  6. Does the pitch lean on urgency, guarantees or “no experience needed”? Those are the claims the FTC has named.

Sources

Checked October 2026. What we read: Zillow’s Zestimate page; the final rule in the Federal Register and its status in the eCFR; the HUD study’s abstract and full text; Zillow’s 8-K, press release and shareholder letter of 2 November 2021; the OCC handbook’s definitions; the four FTC pages and the eCFR penalty table; and the CSBS and FINRA pages. What we could not find: any independent test of whether AI deal-finding tools pick better deals, or published error rates for those tools’ own estimates. If you can show any of this wrong, with a source, we want to see it.

  • real estate
  • ai
  • money
  • valuations
  • scams