Unreliable research

How scientists pressed for time inadvertently made it seem like there was a global jellyfish boom

Flawed citation practices can perpetuate scientific ideas even before they've been fully established as true.

When is a jellyfish plague not (necessarily) a jellyfish plague? When time-poor scientists selectively cite the literature to make it look like the oceans are flooded with jellies – even when it’s far from clear that they really are.

What does scientists being in a rush have to do with jellyfish populations? Let’s start from the beginning.

The identification of patterns and trends in nature happens through the accumulation of consistent observations, published in scientific reports. Once observed, the emerging patterns are usually reported in narrative reviews, which often stimulates a flurry of research activity in that field.

Eventually, the purported patterns are formally tested using “meta-analyses” of the published literature, to either confirm the pattern and establish it as theory, or refute it.

This path from the primary observations to theory can be traced through a network of citations.

Science, however, is done by humans and citation practices are subject to errors of bias and accuracy. Citation practices that are biased in a particular direction have the potential to lead to the identification of false patterns and flawed theory.

Enter the jellies

In the 1990s and 2000s, reports began to appear in the scientific literature of increased jellyfish populations in some parts of the world’s oceans. Various reviews reported the possibility that jellyfish blooms might be increasing globally. Over time, these became increasingly assertive about the existence and extent of the trend, until researchers were asking what to do about the increasingly “gelatinous state” of the oceans worldwide.

The question of whether the global jellyfish boom was real or not was tested by two meta-analyses – which came to opposite conclusions. A 2012 study concluded that populations were increasing globally because they found evidence for increasing populations in 62% of large marine ecosystems tested (although low certainty was assigned to two-thirds of these). The following year, another study found that only 30% of populations were increasing. It concluded that jellyfish populations wax and wane over several decades.

So, in reality, the scientific community is still divided over whether there really has been a sustained global increase in jellyfish numbers.

What about perception?

We wanted to know whether the perception of a global increase in jellyfish blooms was at least partly due to poor citation practices in the scientific literature. Our research, published in Global Ecology and Biogeography, suggests that it was.

Citation practices can be flawed in several ways:

  • Unsupported citations are when authors cite sources that contain no evidence that could possibly support the author’s claim.
  • Selective citations happen when a paper is cited to support a claim but contrasting evidence provided in the same paper is ignored, or when authors choose to cite earlier papers that have since been refuted.
  • Ambiguous citations happen when an author’s sentence contains multiple phrases, but the citations used to support each phrase are clustered at the end of the sentence, preventing readers from telling which is which.
  • Empty citations are when authors cite a paper that cites another paper as evidence for the claim, rather than the original source (also called “lazy author syndrome”).

We comprehensively searched the literature for papers, published before the two meta-analyses, that issued statements regarding trends in jellyfish populations. We classified each statement according to its affirmation and direction (that is, whether it said jellyfish are “increasing”, “may be increasing”, “decreasing”, or “not sure”), as well as their geographic extent (global, multiple regions, or one region).

We then assessed the papers cited as evidence of the statement, to see whether the citations were accurate or whether they fell into one of the categories of flawed citations outlined above.

A (jelly)fishy tale?

Of 159 papers that had issued statements about trends in jellyfish, 61% claimed that populations were increasing (27% at the global scale and 34% in multiple regions) and 25% asserted that populations may be increasing. Only 10% of papers said the data was equivocal. Just one reported that populations were decreasing (but at a local scale).

Most concerning was that only 51% of papers cited were considered to provide unambiguous support for the statements made by the authors. Almost all statements based on unsupportive citations were those claiming that jellyfish were increasing globally (despite the fact that it would have been impossible to make any claims about global trends before the first global meta-analysis was published in 2012). And in all cases, selective citations were biased towards claims that jellyfish populations were increasing.

Pressure to publish in prestigious journals and win research funds may lead some scientists to make claims that reach beyond the evidence available. In most cases, however, citation errors are not overt attempts to distort the evidence. Rather, they probably arise because increasing academic workloads reduce the time available to evaluate papers accurately and to keep abreast of the almost exponential increase in the volume of literature being published.

As scientists, we need to ensure that our claims are always supported by robust evidence because it is apparent that poor citation practices – and, in particular, selective citation of the literature – can distort perceptions within a research field.

Kylie Pitt, Associate Professor, Griffith University; Carlos Duarte, Adjunct professor, King Abdullah University of Science and Technology; Cathy Lucas, Associate Professor, Marine Biology & Ecology Research Group (MBERG), University of Southampton; Charles Novaes de Santana, Postdoctoral research associate, University of Zurich; Marina Sanz-Martín, Researcher, Department of Global Change Research, University of Barcelona, and Rob Condon, Assistant Professor in Biological Oceanography, University of North Carolina Wilmington.

This article first appeared on The Conversation.

We welcome your comments at letters@scroll.in.
Sponsored Content BY 

Top picks, best deals and all that you need to know for the Amazon Great Indian Festival

We’ve done the hard work so you can get right to what you want amongst the 40,000+ offers across 4 days.

The Great Indian Festival (21st-24th September) by Amazon is back and it’s more tempting than ever. This edition will cater to everyone, with offers on a range of products from electronics, home appliances, apparel for men and women, personal care, toys, pet products, gourmet foods, gardening accessories and more. With such overwhelming choice of products and a dozen types of offers, it’s not the easiest to find the best deals in time to buy before your find gets sold out. You need a strategy to make sure you avail the best deals. Here’s your guide on how to make the most out of the Great Indian Festival:

Make use of the Amazon trio – Amazon Prime, Amazon Pay and Amazon app

Though the festival officially starts on 21st, Amazon Prime members will have early access starting at 12 noon on 20th September itself, enabling them to grab the best deals first. Sign up for an Amazon Prime account to not miss out on exclusive deals and products. Throughout the festival, Prime members will 30-minute early access to top deals before non-Prime members. At Rs 499/- a year, the Prime membership also brings unlimited Amazon Prime video streaming and quick delivery benefits.

Load your Amazon pay wallet; there’s assured 10% cashback (up to Rs 500). Amazon will also offer incremental cashbacks over and above bank cashbacks on select brands as a part of its Amazon Pay Offers. Shopping from the app would bring to you a whole world of benefits not available to non-app shoppers. App-only deals include flat Rs 1,250 off on hotels on shopping for more than Rs 500, and flat Rs 1,000 off on flights on a roundtrip booking of Rs 5,000 booking from Yatra. Ten lucky shoppers can also win one year of free travel worth Rs 1.5 lakhs.

Plan your shopping

The Great Indian Sale has a wide range of products, offers, flash sales and lightning deals. To make sure you don’t miss out on the best deals, or lose your mind, plan first. Make a list of things you really need or have been putting off buying. If you plan to buy electronics or appliances, do your research on the specs and shortlist the models or features you prefer. Even better, add them to your wishlist so you’re better able to track your preferred products.

Track the deals

There will be lightning deals and golden hour deals throughout the festival period. Keep track to avail the best of them. Golden-hour deals will be active on the Amazon app from 9.00pm-12.00am, while Prime users will have access to exclusive lightning deals. For example, Prime-only flash sales for Redmi 4 will start at 2.00pm and Redmi 4A at 6.00pm on 20th, while Nokia 6 will be available at Rs 1,000 off. There will be BOGO Offers (Buy One Get One free) and Bundle Offers (helping customers convert their TVs to Smart TVs at a fraction of the cost by using Fire TV Stick). Expect exclusive product launches from brands like Xiaomi (Mi Band 2 HRX 32 GB), HP (HP Sprocket Printer) and other launches from Samsung and Apple. The Half-Price Electronics Store (minimum 50% off) and stores offering minimum Rs 15,000 off will allow deal seekers to discover the top discounts.

Big discounts and top picks

The Great Indian Festival is especially a bonanza for those looking to buy electronics and home appliances. Consumers can enjoy a minimum of 25% off on washing machines, 20% off on refrigerators and 20% off on microwaves, besides deals on other appliances. Expect up to 40% off on TVs, along with No-Cost EMI and up to Rs 20,000 off on exchange.

Home Appliances

Our top picks for washing machines are Haier 5.8 Kg Fully Automatic Top Loading at 32% off, and Bosch Fully Automatic Front Loading 6 Kg and 7 Kg, both available at 27% discount. Morphy Richards 20 L Microwave Oven will be available at a discount of 38%.

Our favorite pick on refrigerators is the large-sized Samsung 545 L at 26% off so you can save Rs 22,710.

There are big savings to be made on UV water purifiers as well (up to 35% off), while several 5-star ACs from big brands will be available at greater than 30% discount. Our top pick is the Carrier 1.5 Ton 5-star split AC at 32% off.

Also those looking to upgrade their TV to a smart one can get Rs. 20,000 off by exchanging it for the Sony Bravia 108cm Android TV.

Personal Electronics

There’s good news for Apple fans. The Apple MacBook Air 13.3-inch Laptop 2017 will be available at Rs 55,990, while the iPad will be available at 20% off. Laptops from Lenovo, Dell and HP will be available in the discount range of 20% to 26%. Top deals are Lenovo Tab3 and Yoga Tab at 41% to 38% off. Apple fans wishing to upgrade to the latest in wearable technology can enjoy Rs 8,000 off on the Apple Watch series 2 smartwatch.

If you’re looking for mobile phones, our top deal pick is the LG V20 at Rs 24,999, more than Rs 5000 off from its pre-sale price.

Power banks always come in handy. Check out the Lenovo 13000 mAh power bank at 30% off.

Home printers are a good investment for frequent flyers and those with kids at home. The discounted prices of home printers at the festival means you will never worry about boarding passes and ID documents again. The HP Deskjet basic printer will be available for Rs 1,579 at 40% off and multi-function (printer/ scanner/ Wi-Fi enabled) printers from HP Deskjet and Canon will also available at 33% off.

The sale is a great time to buy Amazon’s native products. Kindle E-readers and Fire TV Stick will be on sale with offers worth Rs 5,000 and Rs 1,000 respectively.

The Amazon Fire Stick
The Amazon Fire Stick

For those of you who have a bottomless collection of movies, music and photos, there is up to 60% off on hard drives and other storage devices. Our top picks are Rs 15,000 and Rs 12,000 off on Seagate Slim 5TB and 4TB hard drives respectively, available from 8.00am to 4.00pm on 21st September.

The sale will see great discounts of up to 60% off on headphones and speakers from the top brands. The 40% off on Bose QC 25 Headphones is our favourite. Top deals are on Logitech speakers with Logitech Z506 Surround Sound 5.1 multimedia Speakers at 60% off and the super compact JBL Go Portable Speaker at 56% off!

Other noteworthy deals

Cameras (up to 55% off) and camera accessories such as tripods, flash lights etc. are available at a good discount. Home surveillance cameras too will be cheaper. These include bullet cameras, dome cameras, simulated cameras, spy cameras and trail and game cameras.

For home medical supplies and equipment, keep an eye on the grooming and personal care section. Weighing scales, blood pressure monitors, glucometers, body fat monitors etc. will be available at a cheaper price.

The sale is also a good time to invest in home and kitchen supplies. Mixer-grinders and juicers could see lightning deals. Don’t ignore essentials like floor mops with wheels, rotating mop replacements, utensils, crockery etc. Tupperware sets, for example, will be more affordable. There are attractive discounts on bags, especially laptop bags, backpacks, diaper bags and luggage carriers.

Interesting finds

While Amazon is extremely convenient for need-based shopping and daily essentials, it is also full of hidden treasures. During the festival, you can find deals on telescopes, polaroid cameras, smoothie makers, gym equipment, gaming consoles and more. So you’ll be able to allow yourself some indulgences!

Small shopping

If you have children, the festival is good time to stock up on gifts for Diwali, Christmas, return gifts etc. On offer are gaming gadgets such as Xbox, dough sets, Touching Tom Cat, Barbies, classic board games such as Life and more. There are also some products that you don’t really need, but kind of do too, such as smartphone and tablet holders, magnetic car mounts for smartphones and mobile charging station wall stands. If you’re looking for enhanced functionality in daily life, do take a look at the Amazon Basics page. On it you’ll find USB cables, kitchen shears, HDMI cables, notebooks, travel cases and other useful things you don’t realise you need.

Check-out process and payment options

Amazon is also offering an entire ecosystem to make shopping more convenient and hassle-free. For the festival duration, Amazon is offering No-Cost EMIs (zero interest EMIs) on consumer durables, appliances and smartphones, plus exchange schemes and easy installation services in 65 cities. HDFC card holders can avail additional 10% cashback on HDFC credit and debit cards. Customers will also get to “Buy Now and Pay in 2018” with HDFC Credit Cards, as the bank offers a 3 Month EMI Holiday during the days of the sale. Use Amazon Pay balance for fast and easy checkouts, quicker refunds and a secured shopping experience.

Sales are fun and with The Great Indian Festival offering big deals on big brands, it definitely calls for at least window shopping. There’s so much more than the above categories, like minimum 50% off on American Tourister luggage! To start the treasure hunt, click here.

This article was produced by the Scroll marketing team on behalf of Amazon.in and not by the Scroll editorial team.